Advanced Deep Networks for 3D Mitochondria Instance Segmentation. Mitochondria instance segmentation from electron microscopy (EM) images has seen notable progress since the introduction of deep learning methods. In this paper, we propose two advanced deep networks, named Res UNet R and Res UNet H, for 3D mitochondria instance segmentation from Rat and Human samples. Specifically, we design a simple yet effective anisotropic convolution block and deploy a multi scale training strategy, which together boost the segmentation performance. Moreover, we enhance the generalizability of the trained models on the test set by adding a denoising operation as pre processing. In the Large scale 3D Mitochondria Instance Segmentation Challenge at ISBI 2021, our method ranks the 1st place. Code is available at https github.com Limingxing00 MitoEM2021 Challenge.


Onion under Microscope An in depth analysis of the Tor network. Tor is an anonymity network that allows offering and accessing various kinds of resources, known as hidden services, while guaranteeing sender and receiver anonymity. The Tor web is the set of web resources that exist on the Tor network, and Tor websites are part of the so called dark web. Recent research works have evaluated Tor security, evolution over time, and thematic organization. Nevertheless, few information are available about the structure of the graph defined by the network of Tor websites. The limited number of Tor entry points that can be used to crawl the network renders the study of this graph far from being simple. In this paper we aim at better characterizing the Tor Web by analyzing three crawling datasets collected over a five month time frame. On the one hand, we extensively study the global properties of the Tor Web, considering two different graph representations and verifying the impact of Tor's renowned volatility. We present an in depth investigation of the key features of the Tor Web graph showing what makes it different from the surface Web graph. On the other hand, we assess the relationship between contents and structural features. We analyse the local properties of the Tor Web to better characterize the role different services play in the network and to understand to which extent topological features are related to the contents of a service.


Expanding Cybersecurity Knowledge Through an Indigenous Lens A First Look. Decolonization and Indigenous education are at the forefront of Canadian content currently in Academia. Over the last few decades, we have seen some major changes in the way in which we share information. In particular, we have moved into an age of electronically shared content, and there is an increasing expectation in Canada that this content is both culturally significant and relevant. In this paper, we discuss an ongoing community engagement initiative with First Nations communities in the Western Manitoba region. The initiative involves knowledge sharing activities that focus on the topic of cybersecurity, and are aimed at a public audience. This initial look into our educational project focuses on the conceptual analysis and planning stage. We are developing a "Cybersecurity 101" mini curriculum, to be implemented over several one hour long workshops aimed at diverse groups (these public workshops may include a wide range of participants, from tech adverse to tech savvy). Learning assessment tools have been built in to the workshop program. We have created informational and promotional pamphlets, posters, lesson plans, and feedback questionnaires which we believe instill relevance and personal connection to this topic, helping to bridge gaps in accessibility for Indigenous communities while striving to build positive, reciprocal relationships. Our methodology is to approach the subject from a community needs and priorities perspective. Activities are therefore being tailored to fit each community.


Subgraph Federated Learning with Missing Neighbor Generation. Graphs have been widely used in data mining and machine learning due to their unique representation of real world objects and their interactions. As graphs are getting bigger and bigger nowadays, it is common to see their subgraphs separately collected and stored in multiple local systems. Therefore, it is natural to consider the subgraph federated learning setting, where each local system holds a small subgraph that may be biased from the distribution of the whole graph. Hence, the subgraph federated learning aims to collaboratively train a powerful and generalizable graph mining model without directly sharing their graph data. In this work, towards the novel yet realistic setting of subgraph federated learning, we propose two major techniques (1) FedSage, which trains a GraphSage model based on FedAvg to integrate node features, link structures, and task labels on multiple local subgraphs (2) FedSage , which trains a missing neighbor generator along FedSage to deal with missing links across local subgraphs. Empirical results on four real world graph datasets with synthesized subgraph federated learning settings demonstrate the effectiveness and efficiency of our proposed techniques. At the same time, consistent theoretical implications are made towards their generalization ability on the global graphs.


Few shot Font Generation with Weakly Supervised Localized Representations. Automatic few shot font generation aims to solve a well defined, real world problem because manual font designs are expensive and sensitive to the expertise of designers. Existing methods learn to disentangle style and content elements by developing a universal style representation for each font style. However, this approach limits the model in representing diverse local styles, because it is unsuitable for complicated letter systems, for example, Chinese, whose characters consist of a varying number of components (often called "radical") with a highly complex structure. In this paper, we propose a novel font generation method that learns localized styles, namely component wise style representations, instead of universal styles. The proposed style representations enable the synthesis of complex local details in text designs. However, learning component wise styles solely from a few reference glyphs is infeasible when a target script has a large number of components, for example, over 200 for Chinese. To reduce the number of required reference glyphs, we represent component wise styles by a product of component and style factors, inspired by low rank matrix factorization. Owing to the combination of strong representation and a compact factorization strategy, our method shows remarkably better few shot font generation results (with only eight reference glyphs) than other state of the art methods. Moreover, strong locality supervision, for example, location of each component, skeleton, or strokes, was not utilized. The source code is available at https github.com clovaai lffont and https github.com clovaai fewshot font generation.


Simulation of non linear structural elastodynamic and impact problems using minimum energy and simultaneous diagonalization high order bases. We present the application of simultaneous diagonalization and minimum energy (SDME) high order finite element modal bases for simulation of transient non linear elastodynamic problem, including impact cases with neo hookean hyperelastic materials. The bases are constructed using procedures for simultaneous diagonalization of the internal modes and Schur complement of the boundary modes from the standard nodal and modal bases, constructed using Lagrange and Jacobi polynomials, respectively. The implementation of these bases in a high order finite element code is straightforward, since the procedure is applied only to the one dimensional expansion bases. Non linear transient structural problems with large deformation, hyperelastic materials and impact are solved using the obtained bases with explicit and implicit time integration procedures. Iterative solutions based on preconditioned conjugate gradient methods are considered. The performance of the proposed bases in terms of the number of iterations of pre conditioned conjugate gradient methods and computational time are compared with the standard nodal and modal bases. Our numerical tests obtained speedups up to 41 using the considered bases when compared to the standard ones.


Tensor Train Recurrent Neural Networks for Interpretable Multi Way Financial Forecasting. Recurrent Neural Networks (RNNs) represent the de facto standard machine learning tool for sequence modelling, owing to their expressive power and memory. However, when dealing with large dimensional data, the corresponding exponential increase in the number of parameters imposes a computational bottleneck. The necessity to equip RNNs with the ability to deal with the curse of dimensionality, such as through the parameter compression ability inherent to tensors, has led to the development of the Tensor Train RNN (TT RNN). Despite achieving promising results in many applications, the full potential of the TT RNN is yet to be explored in the context of interpretable financial modelling, a notoriously challenging task characterized by multi modal data with low signal to noise ratio. To address this issue, we investigate the potential of TT RNN in the task of financial forecasting of currencies. We show, through the analysis of TT factors, that the physical meaning underlying tensor decomposition, enables the TT RNN model to aid the interpretability of results, thus mitigating the notorious "black box" issue associated with neural networks. Furthermore, simulation results highlight the regularization power of TT decomposition, demonstrating the superior performance of TT RNN over its uncompressed RNN counterpart and other tensor forecasting methods.


The Digital Agricultural Revolution a Bibliometric Analysis Literature Review. The application of digital technologies in agriculture can improve traditional practices to adapt to climate change, reduce Greenhouse Gases (GHG) emissions, and promote a sustainable intensification for food security. Some authors argued that we are experiencing a Digital Agricultural Revolution (DAR) that will boost sustainable farming. This study aims to find evidence of the ongoing DAR process and clarify its roots, what it means, and where it is heading. We investigated the scientific literature with bibliometric analysis tools to produce an objective and reproducible literature review. We retrieved 4995 articles by querying the Web of Science database in the timespan 2012 2019, and we analyzed the obtained dataset to answer three specific research questions i) what is the spectrum of the DAR related terminology? ii) what are the key articles and the most influential journals, institutions, and countries? iii) what are the main research streams and the emerging topics? By grouping the authors' keywords reported on publications, we identified five main research streams Climate Smart Agriculture (CSA), Site Specific Management (SSM), Remote Sensing (RS), Internet of Things (IoT), and Artificial Intelligence (AI). To provide a broad overview of each of these topics, we analyzed relevant review articles, and we present here the main achievements and the ongoing challenges. Finally, we showed the trending topics of the last three years (2017, 2018, 2019).


Nodal solutions of fourth order Kirchhoff equations with critical growth in mathbb R N . We consider a class of fourth order elliptic equations of Kirchhoff type with critical growth in mathbb R N . By using constrained minimization in the Nehari manifold, we establish sufficient conditions for the existence of nodal (that is, sign changing) solutions.


Structural Performance of Laterite soil Stabilised with Cement and Blue Gum (Eucalyptus Globulus) Wood Ash for Use as a Road base Material. This study examines the effect of partially replacing cement with blue gumwood ash (BGWA) in stabilizing laterite soil to be used as a potential road base material. Initially, Ordinary Portland Cement was introduced to the soil at varying contents from 0 to 12 in steps of 3 by weight of the soil sample. Each wet sample of the soil was subjected to the Californian bearing ratio (CBR) and unconfined compressive strength (UCS) tests in determining the optimal soil cement mix. Results show that CBR and UCS values increased as cement content increased, and a 6 cement content corresponding to a UCS value of 2.88 MPa at 7 days of curing met the specifications of the Overseas Road Note 31 to be used in the construction of road bases. The second treatment involved partially replacing the 6 cement content with BGWA in decreasing steps of 1 . Peak CBR value of 348 at 2 BGWA content ( 160 recommended by Kenya road design manual) and UCS value of 2.99 MPa at 7 days of curing were obtained. Thus, BGWA can partially replace cement in stabilizing laterite soil for use in the construction of road bases as per the Overseas Road Note 31 specifications.


Learning Temporal 3D Human Pose Estimation with Pseudo Labels. We present a simple, yet effective, approach for self supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi view self supervision. During training, we rely on triangulating 2D body pose estimates of a multiple view camera system. A temporal convolutional neural network is trained with the generated 3D ground truth and the geometric multi view consistency loss, imposing geometrical constraints on the predicted 3D body skeleton. During inference, our model receives a sequence of 2D body pose estimates from a single view to predict the 3D body pose for each of them. An extensive evaluation shows that our method achieves state of the art performance in the Human3.6M and MPI INF 3DHP benchmarks. Our code and models are publicly available at url https github.com vru2020 TM HPE .


Combining Counterfactual Regret Minimization with Information Gain to Solve Extensive Games with Imperfect Information. Counterfactual regret Minimization (CFR) is an effective algorithm for solving extensive games with imperfect information (IIEG). However, CFR is only allowed to apply in a known environment such as the transition functions of the chance player and reward functions of the terminal nodes are aware in IIEGs. For uncertain scenarios like the cases under Reinforcement Learning (RL), variational information maximizing exploration (VIME) provides a useful framework for exploring environments using information gain. In this paper, we propose a method named VCFR that combines CFR with information gain to calculate Nash Equilibrium (NE) in the scenario of IIEG under RL. By adding information gain to the reward, the average strategy calculated by CFR can be directly used as an interactive strategy, and the exploration efficiency of the algorithm to uncertain environments has been significantly improved. Experimentally, The results demonstrate that this approach can not only effectively reduce the number of interactions with the environment, but also find an approximate NE.


Graph Convolutional Module for Temporal Action Localization in Videos. Temporal action localization has long been researched in computer vision. Existing state of the art action localization methods divide each video into multiple action units (i.e., proposals in two stage methods and segments in one stage methods) and then perform action recognition regression on each of them individually, without explicitly exploiting their relations during learning. In this paper, we claim that the relations between action units play an important role in action localization, and a more powerful action detector should not only capture the local content of each action unit but also allow a wider field of view on the context related to it. To this end, we propose a general graph convolutional module (GCM) that can be easily plugged into existing action localization methods, including two stage and one stage paradigms. To be specific, we first construct a graph, where each action unit is represented as a node and their relations between two action units as an edge. Here, we use two types of relations, one for capturing the temporal connections between different action units, and the other one for characterizing their semantic relationship. Particularly for the temporal connections in two stage methods, we further explore two different kinds of edges, one connecting the overlapping action units and the other one connecting surrounding but disjointed units. Upon the graph we built, we then apply graph convolutional networks (GCNs) to model the relations among different action units, which is able to learn more informative representations to enhance action localization. Experimental results show that our GCM consistently improves the performance of existing action localization methods, including two stage methods (e.g., CBR and R C3D) and one stage methods (e.g., D SSAD), verifying the generality and effectiveness of our GCM.


The Absolute continuity of convolutions of orbital measures in SO(2n 1). Let G be a compact Lie group of Lie type B n , such as SO(2n 1) . We characterize the tuples (x 1 ,...,x L ) of the elements x j in G which have the property that the product of their conjugacy classes has non empty interior. Equivalently, the convolution product of the orbital measures supported on their conjugacy classes is absolutely continuous with respect to Haar measure. The characterization depends on the dimensions of the largest eigenspaces of each x j . Such a characterization was previously only known for the compact Lie groups of type A n .


A Local Deep Learning Method for Solving High Order Partial Differential Equations. At present, deep learning based methods are being employed to resolve the computational challenges of high dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly, and high order derivatives lack robustness for training purposes. We propose a novel approach to solving PDEs with high order derivatives by simultaneously approximating the function value and derivatives. We introduce intermediate variables to rewrite the PDEs into a system of low order differential equations as what is done in the local discontinuous Galerkin method. The intermediate variables and the solutions to the PDEs are simultaneously approximated by a multi output deep neural network. By taking the residual of the system as a loss function, we can optimize the network parameters to approximate the solution. The whole process relies on low order derivatives. Numerous numerical examples are carried out to demonstrate that our local deep learning is efficient, robust, flexible, and is particularly well suited for high dimensional PDEs with high order derivatives.


Asymptotic Distribution of the Zeros of recursively defined Non Orthogonal Polynomials. We study the zero distribution of non orthogonal polynomials attached to g(n) s(n) n 2 begin equation Q n g(x) x sum k 1 n g(k) , Q n k g(x), quad Q 0 g(x) 1. end equation It is known that the case g id involves Chebyshev polynomials of the second kind. The zeros of Q n s(x) are real, simple, and are located in ( 6 sqrt 3 ,0 . Let N n(a,b) be the number of zeros between 6 sqrt 3 leq a b leq 0 . Then we determine a density function v(x) , such that begin equation lim n rightarrow infty frac N n(a,b) n int a b v(x) , , mathrm d x. end equation The polynomials Q n s(x) satisfy a four term recursion. We present in detail an analysis of the fundamental roots and give an answer to an open question on recent work by Adams and Tran Zumba. We extend a method proposed by Freud for orthogonal polynomials to more general systems of polynomials. We determine the underlying moments and density function for the zero distribution.


Variational methods for fluid structure interaction and porous media. In this work we consider a poroelastic flexible material that may deform largely which is situated in an incompressible fluid driven by the Navier Stokes equations in two or three space dimensions. By a variational approach we show existence of weak solutions for a class of such coupled systems. We consider the unsteady case, this means that the PDE for the poroelastic solid involves the Frechet derivative of a non convex functional as well as (second order in time) inertia terms.


Nipah virus vector sequences in COVID 19 patient samples sequenced by the Wuhan Institute of Virology. We report the detection of Nipah virus in an infectious clone format, a BSL4 level pathogen and CDC designated Bioterrorism Agent, in raw RNA Seq sequencing reads deposited by the Wuhan Institute of Virology (WIV) produced from five December 2019 patients infected with SARS CoV 2. Research involving Nipah infectious clones has never been reported to have occured at the WIV. These patient samples have been previously reported to contain reads from several other viruses Influenza A, Spodoptera frugiperda rhabdovirus and Nipah. Previous authors have interpreted the presence of these virus sequences as indicative of co infections of the patients in question by these pathogens or laboratory contamination. However, our analysis shows that NiV genes are encapsulated in synthetic vectors, which we infer was for assembly of a NiV infectious clone. In particular, we document the finding of internal N, P V W C and L protein coding sequences as well as coverage of the G and F genes. Furthermore, the format of Hepatitis D virus ribozyme and T7 terminator downstream of the 5 prime end of the NiV sequence is consistent with truncation required at the end of the genome for a full length infectious clone. This indicates that research at WIV was being conducted on an assembled NiV infectious clone. Contamination of patient sequencing reads by an infectious NiV clone of the highly pathogenic Bangladesh strain could indicate a significant breach of BSL 4 protocols. We call on WIV to explain the purpose of this research on infectious clones of Nipah Virus, the full chronology of this work, and to explain how and at what stage of sample preparation this contamination occurred.


Beyond Single Deletion Correcting Codes Substitutions and Transpositions. We consider the problem of designing low redundancy codes in settings where one must correct deletions in conjunction with substitutions or adjacent transpositions a combination of errors that is usually observed in DNA based data storage. One of the most basic versions of this problem was settled more than 50 years ago by Levenshtein, or one substitution, with nearly optimal redundancy. However, this approach fails to extend to many simple and natural variations of the binary single edit error setting. In this work, we make progress on the code design problem above in three such variations We construct linear time encodable and decodable length n non binary codes correcting a single edit error with nearly optimal redundancy log n O( log log n) , providing an alternative simpler proof of a result by Cai, Chee, Gabrys, Kiah, and Nguyen (IEEE Trans. Inf. Theory 2021). This is achieved by employing what we call weighted VT sketches, a notion that may be of independent interest. We construct linear time encodable and list decodable binary codes with list size 2 for one deletion and one substitution with redundancy 4 log n O( log log n) . This matches the existential bound up to an O( log log n) additive term. We show the existence of a binary code correcting one deletion or one adjacent transposition with nearly optimal redundancy log n O( log log n) .


The synchronized dynamics of time varying networks. Over the past two decades, complex network theory provided the ideal framework for investigating the intimate relationships between the topological properties characterizing the wiring of connections among a system's unitary components and its emergent synchronized functioning. An increased number of setups from the real world found therefore a representation in term of graphs, while more and more sophisticated methods were developed with the aim of furnishing a realistic description of the connectivity patterns under study. In particular, a significant number of systems in physics, biology and social science features a time varying nature of the interactions among their units. We here give a comprehensive review of the major results obtained by contemporary studies on the emergence of synchronization in time varying networks. In particular, two paradigmatic frameworks will be described in details. The first encompasses those systems where the time dependence of the nodes' connections is due to adaptation, external forces, or any other process affecting each of the links of the network. The second framework, instead, corresponds to the case in which the structural evolution of the graph is due to the movement of the nodes, or agents, in physical spaces and to the fact that interactions may be ruled by space dependent laws in a way that connections are continuously switched on and off in the course of the time. Finally, our report ends with a short discussion on promising directions and open problems for future studies.


Public efforts to reduce disease transmission implied from a spatial game. One approach to understand people's efforts to reduce disease transmission, is to consider the effect of behaviour on case rates. In this paper we present a spatial infection reducing game model of public behaviour, formally equivalent to a Hopfield neural network coupled to SIRS disease dynamics. Behavioural game parameters can be precisely calibrated to geographical time series of Covid 19 active case numbers, giving an implied spatial history of behaviour. This is used to investigate the effects of government intervention, quantify behaviour area by area, and measure the effect of wealth on behaviour. We also demonstrate how a delay in people's perception of risk levels can induce behavioural instability, and oscillations in infection rates.


AlignMixup Improving Representations By Interpolating Aligned Features. Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more objects into one image, which is more about efficient processing than interpolation. However, how to best interpolate images is not well defined. In this sense, mixup has been connected to autoencoders, because often autoencoders "interpolate well", for instance generating an image that continuously deforms into another. In this work, we revisit mixup from the interpolation perspective and introduce AlignMix, where we geometrically align two images in the feature space. The correspondences allow us to interpolate between two sets of features, while keeping the locations of one set. Interestingly, this gives rise to a situation where mixup retains mostly the geometry or pose of one image and the texture of the other, connecting it to style transfer. More than that, we show that an autoencoder can still improve representation learning under mixup, without the classifier ever seeing decoded images. AlignMix outperforms state of the art mixup methods on five different benchmarks.


Endangered Languages are not Low Resourced!. The term low resourced has been tossed around in the field of natural language processing to a degree that almost any language that is not English can be called "low resourced" sometimes even just for the sake of making a mundane or mediocre paper appear more interesting and insightful. In a field where English is a synonym for language and low resourced is a synonym for anything not English, calling endangered languages low resourced is a bit of an overstatement. In this paper, I inspect the relation of the endangered with the low resourced from my own experiences.


A pointwise differential inequality and second order regularity for nonlinear elliptic systems. A sharp pointwise differential inequality for vectorial second order partial differential operators, with Uhlenbeck structure, is offered. As a consequence, optimal second order regularity properties of solutions to nonlinear elliptic systems in domains in mathbb R n are derived. Both local and global estimates are established. Minimal assumptions on the boundary of the domain are required for the latter. In the special case of the p Laplace system, our conclusions broaden the range of the admissible values of the exponent p previously known.


Towards a Classification of Rigid Product Quotient Varieties of Kodaira Dimension 0. In this paper the authors study quotients of the product of elliptic curves by a rigid diagonal action of a finite group G . It is shown that only for G operatorname He(3) , mathbb Z 3 2 , and only for dimension geq 4 such an action can be free. A complete classification of the singular quotients in dimension 3 and the smooth quotients in dimension 4 is given. For the other finite groups a strong structure theorem for rigid quotients is proven.


Long tail Recognition via Compositional Knowledge Transfer. In this work, we introduce a novel strategy for long tail recognition that addresses the tail classes' few shot problem via training free knowledge transfer. Our objective is to transfer knowledge acquired from information rich common classes to semantically similar, and yet data hungry, rare classes in order to obtain stronger tail class representations. We leverage the fact that class prototypes and learned cosine classifiers provide two different, complementary representations of class cluster centres in feature space, and use an attention mechanism to select and recompose learned classifier features from common classes to obtain higher quality rare class representations. Our knowledge transfer process is training free, reducing overfitting risks, and can afford continual extension of classifiers to new classes. Experiments show that our approach can achieve significant performance boosts on rare classes while maintaining robust common class performance, outperforming directly comparable state of the art models.


Design Space Exploration of SABER in 65nm ASIC. This paper presents a design space exploration for SABER, one of the finalists in NIST's quantum resistant public key cryptographic standardization effort. Our design space exploration targets a 65nm ASIC platform and has resulted in the evaluation of 6 different architectures. Our exploration is initiated by setting a baseline architecture which is ported from FPGA. In order to improve the clock frequency (the primary goal in our exploration), we have employed several optimizations (i) use of compiled memories in a 'smart synthesis' fashion, (ii) pipelining, and (iii) logic sharing between SABER building blocks. The most optimized architecture utilizes four register files, achieves a remarkable clock frequency of 1GHz while only requiring an area of 0.314mm2. Moreover, physical synthesis is carried out for this architecture and a tapeout ready layout is presented. The estimated dynamic power consumption of the high frequency architecture is approximately 184mW for key generation and 187mW for encapsulation or decapsulation operations. These results strongly suggest that our optimized accelerator architecture is well suited for high speed cryptographic applications.


DIPS Plus The Enhanced Database of Interacting Protein Structures for Interface Prediction. How and where proteins interface with one another can ultimately impact the proteins' functions along with a range of other biological processes. As such, precise computational methods for protein interface prediction (PIP) come highly sought after as they could yield significant advances in drug discovery and design as well as protein function analysis. However, the traditional benchmark dataset for this task, Docking Benchmark 5 (DB5), contains only a modest 230 complexes for training, validating, and testing different machine learning algorithms. In this work, we expand on a dataset recently introduced for this task, the Database of Interacting Protein Structures (DIPS), to present DIPS Plus, an enhanced, feature rich dataset of 42,112 complexes for geometric deep learning of protein interfaces. The previous version of DIPS contains only the Cartesian coordinates and types of the atoms comprising a given protein complex, whereas DIPS Plus now includes a plethora of new residue level features including protrusion indices, half sphere amino acid compositions, and new profile hidden Markov model (HMM) based sequence features for each amino acid, giving researchers a large, well curated feature bank for training protein interface prediction methods. We demonstrate through rigorous benchmarks that training an existing state of the art (SOTA) model for PIP on DIPS Plus yields SOTA results, surpassing the performance of all other models trained on residue level and atom level encodings of protein complexes to date.


Partial order Finding Consensus among Uncertain Feature Attributions. Post hoc feature importance is progressively being employed to explain decisions of complex machine learning models. Yet in practice, reruns of the training algorithm and or the explainer can result in contradicting statements of feature importance, henceforth reducing trust in those techniques. A possible avenue to address this issue is to develop strategies to aggregate diverse explanations about feature importance. While the arithmetic mean, which yields a total order, has been advanced, we introduce an alternative the consensus among multiple models, which results in partial orders. The two aggregation strategies are compared using Integrated Gradients and Shapley values on two regression datasets, and we show that a large portion of the information provided by the mean aggregation is not supported by the consensus of each individual model, raising suspicion on the trustworthiness of this practice.


Counterfactual Explanations for Oblique Decision Trees Exact, Efficient Algorithms. We consider counterfactual explanations, the problem of minimally adjusting features in a source input instance so that it is classified as a target class under a given classifier. This has become a topic of recent interest as a way to query a trained model and suggest possible actions to overturn its decision. Mathematically, the problem is formally equivalent to that of finding adversarial examples, which also has attracted significant attention recently. Most work on either counterfactual explanations or adversarial examples has focused on differentiable classifiers, such as neural nets. We focus on classification trees, both axis aligned and oblique (having hyperplane splits). Although here the counterfactual optimization problem is nonconvex and nondifferentiable, we show that an exact solution can be computed very efficiently, even with high dimensional feature vectors and with both continuous and categorical features, and demonstrate it in different datasets and settings. The results are particularly relevant for finance, medicine or legal applications, where interpretability and counterfactual explanations are particularly important.


Thermoelectric Precession in Turbulent Magnetoconvection. We present laboratory measurements of the interaction between thermoelectric currents and turbulent magnetoconvection. In a cylindrical volume of liquid gallium heated from below and cooled from above and subject to a vertical magnetic field, it is found that the large scale circulation (LSC) can undergo a slow axial precession. Our experiments demonstrate that this LSC precession occurs only when electrically conducting boundary conditions are employed, and that the precession direction reverses when the axial magnetic field direction is flipped. A thermoelectric magnetoconvection (TEMC) model is developed that successfully predicts the zeroth order magnetoprecession dynamics. Our TEMC magnetoprecession model hinges on thermoelectric current loops at the top and bottom boundaries, which create Lorentz forces that generate horizontal torques on the overturning large scale circulatory flow. The thermoelectric torques in our model act to drive a precessional motion of the LSC. This model yields precession frequency predictions that are in good agreement with the experimental observations. We postulate that thermoelectric effects in convective flows, long argued to be relevant in liquid metal heat transfer and mixing processes, may also have applications in planetary interior magnetohydrodynamics.


General Feasibility Bounds for Sample Average Approximation via Vapnik Chervonenkis Dimension. We investigate the feasibility of sample average approximation (SAA) for general stochastic optimization problems, including two stage stochastic programming without the relatively complete recourse assumption. Instead of analyzing problems with specific structures, we utilize results from the Vapnik Chervonenkis (VC) dimension and Probably Approximately Correct learning to provide a general framework that offers explicit feasibility bounds for SAA solutions under minimal structural or distributional assumption. We show that, as long as the hypothesis class formed by the feasbible region has a finite VC dimension, the infeasibility of SAA solutions decreases exponentially with computable rates and explicitly identifiable accompanying constants. We demonstrate how our bounds apply more generally and competitively compared to existing results.


Using Molecular Embeddings in QSAR Modeling Does it Make a Difference?. With the consolidation of deep learning in drug discovery, several novel algorithms for learning molecular representations have been proposed. Despite the interest of the community in developing new methods for learning molecular embeddings and their theoretical benefits, comparing molecular embeddings with each other and with traditional representations is not straightforward, which in turn hinders the process of choosing a suitable representation for QSAR modeling. A reason behind this issue is the difficulty of conducting a fair and thorough comparison of the different existing embedding approaches, which requires numerous experiments on various datasets and training scenarios. To close this gap, we reviewed the literature on methods for molecular embeddings and reproduced three unsupervised and two supervised molecular embedding techniques recently proposed in the literature. We compared these five methods concerning their performance in QSAR scenarios using different classification and regression datasets. We also compared these representations to traditional molecular representations, namely molecular descriptors and fingerprints. As opposed to the expected outcome, our experimental setup consisting of over 25,000 trained models and statistical tests revealed that the predictive performance using molecular embeddings did not significantly surpass that of traditional representations. While supervised embeddings yielded competitive results compared to those using traditional molecular representations, unsupervised embeddings tended to perform worse than traditional representations. Our results highlight the need for conducting a careful comparison and analysis of the different embedding techniques prior to using them in drug design tasks, and motivate a discussion about the potential of molecular embeddings in computer aided drug design.


GWLAN General Word Level AutocompletioN for Computer Aided Translation. Computer aided translation (CAT), the use of software to assist a human translator in the translation process, has been proven to be useful in enhancing the productivity of human translators. Autocompletion, which suggests translation results according to the text pieces provided by human translators, is a core function of CAT. There are two limitations in previous research in this line. First, most research works on this topic focus on sentence level autocompletion (i.e., generating the whole translation as a sentence based on human input), but word level autocompletion is under explored so far. Second, almost no public benchmarks are available for the autocompletion task of CAT. This might be among the reasons why research progress in CAT is much slower compared to automatic MT. In this paper, we propose the task of general word level autocompletion (GWLAN) from a real world CAT scenario, and construct the first public benchmark to facilitate research in this topic. In addition, we propose an effective method for GWLAN and compare it with several strong baselines. Experiments demonstrate that our proposed method can give significantly more accurate predictions than the baseline methods on our benchmark datasets.


SK Tree a systematic malware detection algorithm on streaming trees via the signature kernel. The development of machine learning algorithms in the cyber security domain has been impeded by the complex, hierarchical, sequential and multimodal nature of the data involved. In this paper we introduce the notion of a streaming tree as a generic data structure encompassing a large portion of real world cyber security data. Starting from host based event logs we represent computer processes as streaming trees that evolve in continuous time. Leveraging the properties of the signature kernel, a machine learning tool that recently emerged as a leading technology for learning with complex sequences of data, we develop the SK Tree algorithm. SK Tree is a supervised learning method for systematic malware detection on streaming trees that is robust to irregular sampling and high dimensionality of the underlying streams. We demonstrate the effectiveness of SK Tree to detect malicious events on a portion of the publicly available DARPA OpTC dataset, achieving an AUROC score of 98 .


Donoghue m functions for singular Sturm Liouville operators. Let dot A be a densely defined, closed, symmetric operator in the complex, separable Hilbert space mathcal H with equal deficiency indices and denote by mathcal N i ker big( big( dot A big) i I mathcal H big) , dim , ( mathcal N i) k in mathbb N cup infty , the associated deficiency subspace of dot A . If A denotes a self adjoint extension of dot A in mathcal H , the Donoghue m operator M A, mathcal N i Do ( , cdot ,) in mathcal N i associated with the pair (A, mathcal N i) is given by M A, mathcal N i Do (z) zI mathcal N i (z 2 1) P mathcal N i (A z I mathcal H ) 1 P mathcal N i big vert mathcal N i ,, quad z in mathbb C backslash mathbb R , with I mathcal N i the identity operator in mathcal N i , and P mathcal N i the orthogonal projection in mathcal H onto mathcal N i . Assuming the standard local integrability hypotheses on the coefficients p, q,r , we study all self adjoint realizations corresponding to the differential expression tau frac 1 r(x) left frac d dx p(x) frac d dx q(x) right , text for a.e. x in(a,b) subseteq mathbb R , in L 2((a,b) rdx) , and, as the principal aim of this paper, systematically construct the associated Donoghue m functions (resp., 2 times 2 matrices) in all cases where tau is in the limit circle case at least at one interval endpoint a or b .


A Survey on Security Issues of 5G NR Perspective of Artificial Dust and Artificial Rain. 5G NR (New Radio) incorporates concepts of novel technologies such as spectrum sharing, D2D communication, UDN, and massive MIMO. However, providing security and identifying the security threats to these technologies occupies the prime concern. This paper intends to provide an ample survey of security issues and their countermeasures encompassed in the technologies of 5G NR. Further, security concerns of each technology are defined mathematically. Thereby defining the impact on the factors of security. Moreover, a methodology is developed in which the influence on security due to artificially generated rain and artificially generated dust on the wireless communication network is studied. By doing so, an attacking scenario is identified, where a half duplex attack in D2D communication is attained. Half duplex attack specifies the attack solely on the downlink to spoof the allocated resources, with reduced miss rate. Thus, ultra reliable and adequate advances are required to be addressed to remove the obstacles that create a hindrance in achieving the secured and authenticated communicating network


Tackling the Background Bias in Sparse Object Detection via Cropped Windows. Object detection on Unmanned Aerial Vehicles (UAVs) is still a challenging task. The recordings are mostly sparse and contain only small objects. In this work, we propose a simple tiling method that improves the detection capability in the remote sensing case without modifying the model itself. By reducing the background bias and enabling the usage of higher image resolutions during training, our method can improve the performance of models substantially. The procedure was validated on three different data sets and outperformed similar approaches in performance and speed.


Asymptotic formulae and inequalities for point spectrum in max algebra. We prove new explicit asymptotic formulae between (geometric) eigenvalues in max algebra and classical distinguished eigenvalues of nonnegative matrices, which are useful tools for transferring results between both settings. We establish new inequalities for both types of eigenvalues of Hadamard products and Hadamard weighted geometric means of nonnegative matrices. Moreover, a version of the spectral mapping theorem for the distinguished spectrum is pointed out.


A Context Aware Information Based Clone Node Attack Detection Scheme in Internet of Things. The rapidly expanding nature of the Internet of Things (IoT) networks is beginning to attract interest across a range of applications, including smart homes, smart transportation, smart health, and industrial contexts. This cutting edge technology enables individuals to track and control their integrated environment in real time and remotely via a thousand IoT devices comprised of sensors and actuators that actively participate in sensing, processing, storing, and sharing information. Nonetheless, IoT devices are frequently deployed in hostile environments, wherein adversaries attempt to capture and breach them in order to seize control of the entire network. One such example of potentially malicious behaviour is the cloning of IoT devices, in which an attacker can physically capture the devices, obtain some sensitive information, duplicate the devices, and intelligently deploy them in desired locations to conduct various insider attacks. A device cloning attack on IoT networks is a significant security concern since it allows for selective forwarding, sink hole, and black hole attacks. To address this issue, this paper provides an efficient scheme for detecting clone node attacks on IoT networks that makes use of semantic information about IoT devices known as context information sensed from the deployed environment to locate them securely. We design a location proof mechanism by combining location proofs and batch verification of the extended elliptic curve digital signature technique to accelerate the verification process at selected trusted nodes. We demonstrate the security of our scheme and its resilience to secure clone node attack detection by conducting a comprehensive security analysis. The performance of our proposed scheme provides a high degree of detection accuracy with minimal detection time and significantly reduces the computation, communication and storage overhead.


Compositional Game Theory, Compositionally. We present a new compositional approach to compositional game theory (CGT) based upon Arrows, a concept originally from functional programming, closely related to Tambara modules, and operators to build new Arrows from old. We model equilibria as a bimodule over an Arrow and define an operator to build a new Arrow from such a bimodule over an existing Arrow. We also model strategies as graded Arrows and define an operator which builds a new Arrow by taking the colimit of a graded Arrow. A final operator builds a graded Arrow from a graded bimodule. We use this compositional approach to CGT to show how known and previously unknown variants of open games can be proven to form symmetric monoidal categories.


The Typed Graph Model a Supermodel for Model Management and Data Integration. In recent years, the Graph Model has become increasingly popular, especially in the application domain of social networks. The model has been semantically augmented with properties and labels attached to the graph elements. It is difficult to ensure data quality for the properties and the data structure because the model does not need a schema. In this paper, we propose a schema bound Typed Graph Model with properties and labels. These enhancements improve not only data quality but also the quality of graph analysis. The power of this model is provided by using hyper nodes and hyper edges, which allows to present data structures on different abstraction levels. We prove that the model is at least equivalent in expressive power to most popular data models. Therefore, it can be used as a supermodel for model management and data integration. We illustrate by example the superiority of this model over the property graph data model of Hidders and other prevalent data models, namely the relational, object oriented, XML model, and RDF Schema.


Improving Single Image Defocus Deblurring How Dual Pixel Images Help Through Multi Task Learning. Many camera sensors use a dual pixel (DP) design that operates as a rudimentary light field providing two sub aperture views of a scene in a single capture. The DP sensor was developed to improve how cameras perform autofocus. Since the DP sensor's introduction, researchers have found additional uses for the DP data, such as depth estimation, reflection removal, and defocus deblurring. We are interested in the latter task of defocus deblurring. In particular, we propose a single image deblurring network that incorporates the two sub aperture views into a multi task framework. Specifically, we show that jointly learning to predict the two DP views from a single blurry input image improves the network's ability to learn to deblur the image. Our experiments show this multi task strategy achieves 1dB PSNR improvement over state of the art defocus deblurring methods. In addition, our multi task framework allows accurate DP view synthesis (e.g., 39dB PSNR) from the single input image. These high quality DP views can be used for other DP based applications, such as reflection removal. As part of this effort, we have captured a new dataset of 7,059 high quality images to support our training for the DP view synthesis task. Our dataset, code, and trained models are publicly available at https github.com Abdullah Abuolaim multi task defocus deblurring dual pixel nimat.


State Space Constraints Improve the Generalization of the Differentiable Neural Computer in some Algorithmic Tasks. Memory augmented neural networks (MANNs) can solve algorithmic tasks like sorting. However, they often do not generalize to lengths of input sequences not seen in the training phase. Therefore, we introduce two approaches constraining the state space of the network controller to improve the generalization to out of distribution sized input sequences state compression and state regularization. We show that both approaches can improve the generalization capability of a particular type of MANN, the differentiable neural computer (DNC), and compare our approaches to a stateful and a stateless controller on a set of algorithmic tasks. Furthermore, we show that especially the combination of both approaches can enable a pre trained DNC to be extended post hoc with a larger memory. Thus, our introduced approaches allow to train a DNC using shorter input sequences and thus save computational resources. Moreover, we observed that the capability for generalization is often accompanied by loop structures in the state space, which could correspond to looping constructs in algorithms.


Animated Condensed Sets and Their Homotopy Groups. The theory of condensed mathematics by Dustin Clausen and Peter Scholze claims that topological spaces should be replaced by the definition of condensed sets. The main purpose of this paper is to investigate in which way the theory of homotopy groups on topological spaces can be extended to the theory of condensed sets. We show that there exist functors from the category of condensed sets to the category of pro groups, s.t. restriction to CW spaces coincides with the ordinary notion of homotopy groups on topological spaces. These functors can be extended to the infty categories of condensed anima and pro anima. On our way to these results we will prove that the compact projective objects in the category of condensed sets are given by the extremally disconnected profinite sets.


Completeness theorem for the system of eigenfunctions of the complex Schr "odinger operator mathscr L c d 2 dx 2 cx alpha . The completeness of the system of eigenfunctions of the complex Schr "odinger operator mathscr L c d 2 dx 2 cx alpha on the semi axis with Dirichlet boundary conditions is proved for alpha in(0,2) and arg c 2 pi alpha ( alpha 2) Delta t( alpha) with some Delta t( alpha) 0 .


Out of Distribution Detection in Dermatology using Input Perturbation and Subset Scanning. Recent advances in deep learning have led to breakthroughs in the development of automated skin disease classification. As we observe an increasing interest in these models in the dermatology space, it is crucial to address aspects such as the robustness towards input data distribution shifts. Current skin disease models could make incorrect inferences for test samples from different hardware devices and clinical settings or unknown disease samples, which are out of distribution (OOD) from the training samples. To this end, we propose a simple yet effective approach that detect these OOD samples prior to making any decision. The detection is performed via scanning in the latent space representation (e.g., activations of the inner layers of any pre trained skin disease classifier). The input samples could also perturbed to maximise divergence of OOD samples. We validate our ODD detection approach in two use cases 1) identify samples collected from different protocols, and 2) detect samples from unknown disease classes. Additionally, we evaluate the performance of the proposed approach and compare it with other state of the art methods. Furthermore, data driven dermatology applications may deepen the disparity in clinical care across racial and ethnic groups since most datasets are reported to suffer from bias in skin tone distribution. Therefore, we also evaluate the fairness of these OOD detection methods across different skin tones. Our experiments resulted in competitive performance across multiple datasets in detecting OOD samples, which could be used (in the future) to design more effective transfer learning techniques prior to inferring on these samples.


Watt level blue light for precision spectroscopy, laser cooling and trapping of strontium and cadmium atoms. High power and narrow linewidth laser light is a vital tool for atomic physics, being used for example in laser cooling and trapping and precision spectroscopy. Here we produce Watt level laser radiation at 457.49 nm and 460.86 nm of respective relevance for the cooling transitions of cadmium and strontium atoms. This is achieved via the frequency doubling of a kHz linewidth vertical external cavity surface emitting laser (VECSEL), which is based on a novel gain chip design enabling lasing at 2 W in the 915 928 nm region. Following an additional doubling stage, spectroscopy of the 1S 0 to 1P 1 cadmium transition at 228.89 nm is performed on an atomic beam, with all the transitions from all eight natural isotopes observed in a single continuous sweep of more than 4 GHz in the deep ultraviolet. The absolute value of the transition frequency of Cd 114 and the isotope shifts relative to this transition are determined, with values for some of these shifts provided for the first time


A simple counterexample for the permanent on top conjecture. The permanent on top conjecture states that the largest eigenvalue of the Schur power matrix of a positive semi definite Hermitian matrix H is per(H). A counterexample has been found with the help of computers, but here, I present another counterexample that can be checked by hand. My method is to use linear representations of groups to connect the spectrum of the Schur power matrix with the spectra of the entrywise(Hadamard) product matrices of permanental compound matrices. By that, we are able to study the properties of the spectrum of the Schur power matrix through the entrywise(Hadamard) product matrices of permanental compound matrices. The counterexample we find is in fact also a counterexample to a weaker conjecture related to permanental compound matrices. This conjecture was also known to be false, but the new counterexample is smaller than the known one.


Who Blames or Endorses Whom? Entity to Entity Directed Sentiment Extraction in News Text. Understanding who blames or supports whom in news text is a critical research question in computational social science. Traditional methods and datasets for sentiment analysis are, however, not suitable for the domain of political text as they do not consider the direction of sentiments expressed between entities. In this paper, we propose a novel NLP task of identifying directed sentiment relationship between political entities from a given news document, which we call directed sentiment extraction. From a million scale news corpus, we construct a dataset of news sentences where sentiment relations of political entities are manually annotated. We present a simple but effective approach for utilizing a pretrained transformer, which infers the target class by predicting multiple question answering tasks and combining the outcomes. We demonstrate the utility of our proposed method for social science research questions by analyzing positive and negative opinions between political entities in two major events 2016 U.S. presidential election and COVID 19. The newly proposed problem, data, and method will facilitate future studies on interdisciplinary NLP methods and applications.


Pool of Experts Realtime Querying Specialized Knowledge in Massive Neural Networks. In spite of the great success of deep learning technologies, training and delivery of a practically serviceable model is still a highly time consuming process. Furthermore, a resulting model is usually too generic and heavyweight, and hence essentially goes through another expensive model compression phase to fit in a resource limited device like embedded systems. Inspired by the fact that a machine learning task specifically requested by mobile users is often much simpler than it is supported by a massive generic model, this paper proposes a framework, called Pool of Experts (PoE), that instantly builds a lightweight and task specific model without any training process. For a realtime model querying service, PoE first extracts a pool of primitive components, called experts, from a well trained and sufficiently generic network by exploiting a novel conditional knowledge distillation method, and then performs our train free knowledge consolidation to quickly combine necessary experts into a lightweight network for a target task. Thanks to this train free property, in our thorough empirical study, PoE can build a fairly accurate yet compact model in a realtime manner, whereas it takes a few minutes per query for the other training methods to achieve a similar level of the accuracy.


Computing complete hyperbolic structures on cusped 3 manifolds. A fundamental way to study 3 manifolds is through the geometric lens, one of the most prominent geometries being the hyperbolic one. We focus on the computation of a complete hyperbolic structure on a connected orientable hyperbolic 3 manifold with torus boundaries. This family of 3 manifolds includes the knot complements. This computation of a hyperbolic structure requires the resolution of gluing equations on a triangulation of the space, but not all triangulations admit a solution to the equations. In this paper, we propose a new method to find a triangulation that admits a solution to the gluing equations, using convex optimization and combinatorial modifications. It is based on Casson and Rivin s reformulation of the equations. We provide a novel approach to modify a triangulation and update its geometry, along with experimental results to support the new method.


A Projected Gradient Method for Opinion Optimization with Limited Changes of Susceptibility to Persuasion. Many social phenomena are triggered by public opinion that is formed in the process of opinion exchange among individuals. To date, from the engineering point of view, a large body of work has been devoted to studying how to manipulate individual opinions so as to guide public opinion towards the desired state. Recently, Abebe et al. (KDD 2018) have initiated the study of the impact of interventions at the level of susceptibility rather than the interventions that directly modify individual opinions themselves. For the model, Chan et al. (The Web Conference 2019) designed a local search algorithm to find an optimal solution in polynomial time. However, it can be seen that the solution obtained by solving the above model might not be implemented in real world scenarios. In fact, as we do not consider the amount of changes of the susceptibility, it would be too costly to change the susceptibility values for agents based on the solution. In this paper, we study an opinion optimization model that is able to limit the amount of changes of the susceptibility in various forms. First we introduce a novel opinion optimization model, where the initial susceptibility values are given as additional input and the feasible region is defined using the ell p ball centered at the initial susceptibility vector. For the proposed model, we design a projected gradient method that is applicable to the case where there are millions of agents. Finally we conduct thorough experiments using a variety of real world social networks and demonstrate that the proposed algorithm outperforms baseline methods.


Polarization inhibits the phase transition of Axelrod's model. We study the effect of polarization in Axelrod's model of cultural dissemination. This is done through the introduction of a cultural feature that takes only two values, while the other features can present a larger number of possible traits. Our numerical results and mean field approximations show that polarization reduces the characteristic phase transition of the original model to a finite size effect, since at the thermodynamic limit only the ordered phase is present. Furthermore, for finite system sizes, the stationary state depends on the percolation threshold of the network where the model is implemented a polarized phase is obtained for percolation thresholds below 1 2, a fragmented multicultural one otherwise.


Are Privacy Dashboards Good for End Users? Evaluating User Perceptions and Reactions to Google's My Activity (Extended Version). Privacy dashboards and transparency tools help users review and manage the data collected about them online. Since 2016, Google has offered such a tool, My Activity, which allows users to review and delete their activity data from Google services. We conducted an online survey with n 153 participants to understand if Google's My Activity, as an example of a privacy transparency tool, increases or decreases end users' concerns and benefits regarding data collection. While most participants were aware of Google's data collection, the volume and detail was surprising, but after exposure to My Activity, participants were significantly more likely to be both less concerned about data collection and to view data collection more beneficially. Only 25 , indicated that they would change any settings in the My Activity service or change any behaviors. This suggests that privacy transparency tools are quite beneficial for online services as they garner trust with their users and improve their perceptions without necessarily changing users' behaviors. At the same time, though, it remains unclear if such transparency tools actually improve end user privacy by sufficiently assisting or motivating users to change or review data collection settings.


T2VLAD Global Local Sequence Alignment for Text Video Retrieval. Text video retrieval is a challenging task that aims to search relevant video contents based on natural language descriptions. The key to this problem is to measure text video similarities in a joint embedding space. However, most existing methods only consider the global cross modal similarity and overlook the local details. Some works incorporate the local comparisons through cross modal local matching and reasoning. These complex operations introduce tremendous computation. In this paper, we design an efficient global local alignment method. The multi modal video sequences and text features are adaptively aggregated with a set of shared semantic centers. The local cross modal similarities are computed between the video feature and text feature within the same center. This design enables the meticulous local comparison and reduces the computational cost of the interaction between each text video pair. Moreover, a global alignment method is proposed to provide a global cross modal measurement that is complementary to the local perspective. The global aggregated visual features also provide additional supervision, which is indispensable to the optimization of the learnable semantic centers. We achieve consistent improvements on three standard text video retrieval benchmarks and outperform the state of the art by a clear margin.


Simulating pharmaceutical treatment effects on osteoporosis via a bone remodeling algorithm targeting hypermineralized sites. Pharmaceutical treatments can slow bone degradation, thus reducing the fracture risk inherent in osteoporosis. Antiresorptive treatments block the over activation of osteoclasts vs osteoblasts, but the resulting decrease in bone remodeling frequency may weaken bone structure over time, with no gain in bone volume. Anabolic treatments, however, induce gain in bone volume. The quantitative results from existing studies on the effects of treatments over time are general and nonpatient specific, while numerical models simulating evolution of patient specific bone microarchitecture consider a spatially random distribution of the remodeling process. Here, we propose a new approach to simulate the remodeling over decades of an individual patient's bone microarchitecture, based on the hypothesis that the oldest sites, which are hypermineralized and more brittle, are remodeled first. Taking these older sites as prime targets of remodeling, simulations show that severe osteoporosis profoundly degrades the mechanical properties of the bone structure, which can be restored and even improved by anabolic, more than by antiresorptive, therapies.


Optimal Hardy inequality for the fractional Laplacian on L p . For the fractional Laplacian we give Hardy inequality which is optimal in L p for 1 p infty . As an application, we explicitly characterize the contractivity of the corresponding Feynman Kac semigroups on L p .


NAS HPO Bench II A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameters. The benchmark datasets for neural architecture search (NAS) have been developed to alleviate the computationally expensive evaluation process and ensure a fair comparison. Recent NAS benchmarks only focus on architecture optimization, although the training hyperparameters affect the obtained model performances. Building the benchmark dataset for joint optimization of architecture and training hyperparameters is essential to further NAS research. The existing NAS HPO Bench is a benchmark for joint optimization, but it does not consider the network connectivity design as done in modern NAS algorithms. This paper introduces the first benchmark dataset for joint optimization of network connections and training hyperparameters, which we call NAS HPO Bench II. We collect the performance data of 4K cell based convolutional neural network architectures trained on the CIFAR 10 dataset with different learning rate and batch size settings, resulting in the data of 192K configurations. The dataset includes the exact data for 12 epoch training. We further build the surrogate model predicting the accuracies after 200 epoch training to provide the performance data of longer training epoch. By analyzing NAS HPO Bench II, we confirm the dependency between architecture and training hyperparameters and the necessity of joint optimization. Finally, we demonstrate the benchmarking of the baseline optimization algorithms using NAS HPO Bench II.


Discovering the Information that is lost in our Databases Why bother storing data if you can't find the information?. We are surrounded by an ever increasing amount of data that is stored in a variety of databases. In this article we will use a very liberal definition of EM database . Basically any collection of data can be regarded as a database, ranging from the files in a directory on a disk, to ftp and web servers, through to relational or object oriented databases. The sole reason for storing data in databases is that there is an anticipated need for the stored data at some time in the future. This means that providing smooth access paths by which stored information can be retrieved is at least as important as ensuring integrity of the stored information. In practice, however, providing users with adequate avenues by which to access stored information has received far less attention.


An Empirical Study on Few shot Knowledge Probing for Pretrained Language Models. Prompt based knowledge probing for 1 hop relations has been used to measure how much world knowledge is stored in pretrained language models. Existing work uses considerable amounts of data to tune the prompts for better performance. In this work, we compare a variety of approaches under a few shot knowledge probing setting, where only a small number (e.g., 10 or 20) of example triples are available. In addition, we create a new dataset named TREx 2p, which contains 2 hop relations. We report that few shot examples can strongly boost the probing performance for both 1 hop and 2 hop relations. In particular, we find that a simple yet effective approach of finetuning the bias vectors in the model outperforms existing prompt engineering methods. Our dataset and code are available at url https github.com cloudygoose fewshot lama .


Pareto Navigation Gradient Descent a First Order Algorithm for Optimization in Pareto Set. Many modern machine learning applications, such as multi task learning, require finding optimal model parameters to trade off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on the set of (often infinite number of) models that cannot be strictly improved. But it does not provide an actionable procedure for picking one or a few special models to return to practical users. In this paper, we consider emph optimization in Pareto set (OPT in Pareto) , the problem of finding Pareto models that optimize an extra reference criterion function within the Pareto set. This function can either encode a specific preference from the users, or represent a generic diversity measure for obtaining a set of diversified Pareto models that are representative of the whole Pareto set. Unfortunately, despite being a highly useful framework, efficient algorithms for OPT in Pareto have been largely missing, especially for large scale, non convex, and non linear objectives in deep learning. A naive approach is to apply Riemannian manifold gradient descent on the Pareto set, which yields a high computational cost due to the need for eigen calculation of Hessian matrices. We propose a first order algorithm that approximately solves OPT in Pareto using only gradient information, with both high practical efficiency and theoretically guaranteed convergence property. Empirically, we demonstrate that our method works efficiently for a variety of challenging multi task related problems.


Controlled Cue Generation for Play Scripts. In this paper, we use a large scale play scripts dataset to propose the novel task of theatrical cue generation from dialogues. Using over one million lines of dialogue and cues, we approach the problem of cue generation as a controlled text generation task, and show how cues can be used to enhance the impact of dialogue using a language model conditioned on a dialogue cue discriminator. In addition, we explore the use of topic keywords and emotions for controlled text generation. Extensive quantitative and qualitative experiments show that language models can be successfully used to generate plausible and attribute controlled texts in highly specialised domains such as play scripts. Supporting materials can be found at https catlab team.github.io cuegen.


On realizations of the subalgebra A R(1) of the R motivic Steenrod Algebra. In this paper, we show that the finite subalgebra mathcal A mathbb R (1) , generated by mathrm Sq 1 and mathrm Sq 2 , of the mathbb R motivic Steenrod algebra mathcal A mathbb R can be given 128 different mathcal A mathbb R module structures. We also show that all of these mathcal A mathbb R modules can be realized as the cohomology of a 2 local finite mathbb R motivic spectrum. The realization results are obtained using an mathbb R motivic analogue of the Toda realization theorem. We notice that each realization of mathcal A mathbb R (1) can be expressed as a cofiber of an mathbb R motivic v 1 self map. The mathrm C 2 equivariant analogue of the above results then follows because of the Betti realization functor. We identify a relationship between the mathrm RO ( mathrm C 2) graded Steenrod operations on a mathrm C 2 equivariant space and the classical Steenrod operations on both its underlying space and its fixed points. This technique is then used to identify the geometric fixed point spectra of the mathrm C 2 equivariant realizations of mathcal A mathrm C 2 (1) . We find another application of the mathbb R motivic Toda realization theorem we produce an mathbb R motivic, and consequently a mathrm C 2 equivariant, analogue of the Bhattacharya Egger spectrum mathcal Z , which could be of independent interest.


A Comparison of Word2Vec, HMM2Vec, and PCA2Vec for Malware Classification. Word embeddings are often used in natural language processing as a means to quantify relationships between words. More generally, these same word embedding techniques can be used to quantify relationships between features. In this paper, we first consider multiple different word embedding techniques within the context of malware classification. We use hidden Markov models to obtain embedding vectors in an approach that we refer to as HMM2Vec, and we generate vector embeddings based on principal component analysis. We also consider the popular neural network based word embedding technique known as Word2Vec. In each case, we derive feature embeddings based on opcode sequences for malware samples from a variety of different families. We show that we can obtain better classification accuracy based on these feature embeddings, as compared to HMM experiments that directly use the opcode sequences, and serve to establish a baseline. These results show that word embeddings can be a useful feature engineering step in the field of malware analysis.


Minimal unique palindromic substrings after single character substitution. A palindrome is a string that reads the same forward and backward. A palindromic substring w of a string T is called a minimal unique palindromic substring (MUPS) of T if w occurs only once in T and any proper palindromic substring of w occurs at least twice in T . MUPSs are utilized for answering the shortest unique palindromic substring problem, which is motivated by molecular biology Inoue et al., 2018 . Given a string T of length n , all MUPSs of T can be computed in O(n) time. In this paper, we study the problem of updating the set of MUPSs when a character in the input string T is substituted by another character. We first analyze the number d of changes of MUPSs when a character is substituted, and show that d is in O( log n) . Further, we present an algorithm that uses O(n) time and space for preprocessing, and updates the set of MUPSs in O( log sigma ( log log n) 2 d) time where sigma is the alphabet size. We also propose a variant of the algorithm, which runs in optimal O(1 d) time when the alphabet size is constant.


Binary quadratic forms and the factorization method of Gauss. In Disquisitiones Arithmeticae, Gauss studied binary quadratic forms and introduced a very general version of a composition operator that allows composing even forms of different discriminants and imprimitive forms. Section V of Disquisitiones contains truly revolutionary ideas and involves very complicated computations, sometimes left to the reader. With this theory, Gauss develops a method of factorization using quadratic residues obtained by binary quadratic forms. In this work we explore Gauss method making many of the computations necessary to better understand his work.


Reconstruction of Sets of Strings from Prefix Suffix Compositions. The problem of reconstructing strings from substring information has found many applications due to its importance in genomic data sequencing and DNA and polymer based data storage. One practically important and challenging paradigm requires reconstructing mixtures of strings based on the union of compositions of their prefixes and suffixes, generated by mass spectrometry devices. We describe new coding methods that allow for unique joint reconstruction of subsets of strings selected from a code and provide upper and lower bounds on the asymptotic rate of the underlying codebooks. Our code constructions combine properties of binary Bh and Dyck strings and that can be extended to accommodate missing substrings in the pool. As auxiliary results, we obtain the first known bounds on binary Bh sequences for arbitrary even parameters h, and also describe various error models inherent to mass spectrometry analysis. This paper contains a correction of the prior work by the authors, published in 24 . In particular, the bounds on the prefix codes are now corrected.


Look Before You Leap Safe Model Based Reinforcement Learning with Human Intervention. Safety has become one of the main challenges of applying deep reinforcement learning to real world systems. Currently, the incorporation of external knowledge such as human oversight is the only means to prevent the agent from visiting the catastrophic state. In this paper, we propose MBHI, a novel framework for safe model based reinforcement learning, which ensures safety in the state level and can effectively avoid both "local" and "non local" catastrophes. An ensemble of supervised learners are trained in MBHI to imitate human blocking decisions. Similar to human decision making process, MBHI will roll out an imagined trajectory in the dynamics model before executing actions to the environment, and estimate its safety. When the imagination encounters a catastrophe, MBHI will block the current action and use an efficient MPC method to output a safety policy. We evaluate our method on several safety tasks, and the results show that MBHI achieved better performance in terms of sample efficiency and number of catastrophes compared to the baselines.


Long term IaaS Provider Selection using Short term Trial Experience. We propose a novel approach to select privacy sensitive IaaS providers for a long term period. The proposed approach leverages a consumer's short term trial experiences for long term selection. We design a novel equivalence partitioning based trial strategy to discover the temporal and unknown QoS performance variability of an IaaS provider. The consumer's long term workloads are partitioned into multiple Virtual Machines in the short term trial. We propose a performance fingerprint matching approach to ascertain the confidence of the consumer's trial experience. A trial experience transformation method is proposed to estimate the actual long term performance of the provider. Experimental results with real world datasets demonstrate the efficiency of the proposed approach.


The structure of the unit group of the group algebra F(C 3 times D 10 ) . Let D n be the dihedral group of order n . The structure of the unit group U(F(C 3 times D 10 )) of the group algebra F(C 3 times D 10 ) over a finite field F of characteristic 3 is given in cite sh13 . In this article, the structure of U(F(C 3 times D 10 )) is obtained over any finite field F of characteristic p neq 3 .


Generating Gender Augmented Data for NLP. Gender bias is a frequent occurrence in NLP based applications, especially pronounced in gender inflected languages. Bias can appear through associations of certain adjectives and animate nouns with the natural gender of referents, but also due to unbalanced grammatical gender frequencies of inflected words. This type of bias becomes more evident in generating conversational utterances where gender is not specified within the sentence, because most current NLP applications still work on a sentence level context. As a step towards more inclusive NLP, this paper proposes an automatic and generalisable rewriting approach for short conversational sentences. The rewriting method can be applied to sentences that, without extra sentential context, have multiple equivalent alternatives in terms of gender. The method can be applied both for creating gender balanced outputs as well as for creating gender balanced training data. The proposed approach is based on a neural machine translation (NMT) system trained to 'translate' from one gender alternative to another. Both the automatic and manual analysis of the approach show promising results for automatic generation of gender alternatives for conversational sentences in Spanish.


A short proof of a new combinatorial identity. While working with Grothendieck's Quot schemes and their virtual enumerative invariants, the author came across a combinatorial identity which would have followed as a consequence of a very general abstract machinery. We dedicate this short note to give a combinatorial proof of this identity which is closely related to the Lagrange inversion. A special case of the result was proved by Mathoverflow users "Alex Gavrilov" and "esg" answering our enquiry.


The latent structure of global scientific development. Science is essential to innovation and economic prosperity. Although studies have shown that national scientific development is affected by geographic, historic, and economic factors, it remains unclear whether there are universal structures and trajectories of national scientific development that can inform forecasting and policymaking. Here, by examining countries' scientific 'exports' publications that are indexed in international databases we reveal a three cluster structure in the relatedness network of disciplines that underpin national scientific development and the organization of global science. Tracing the evolution of national research portfolios reveals that while nations are proceeding to more diverse research profiles individually, scientific production is increasingly specialized in global science over the past decades. By uncovering the underlying structure of scientific development and connecting it with economic development, our results may offer a new perspective on the evolution of global science.


Re parameterizing VAEs for stability. We propose a theoretical approach towards the training numerical stability of Variational AutoEncoders (VAE). Our work is motivated by recent studies empowering VAEs to reach state of the art generative results on complex image datasets. These very deep VAE architectures, as well as VAEs using more complex output distributions, highlight a tendency to haphazardly produce high training gradients as well as NaN losses. The empirical fixes proposed to train them despite their limitations are neither fully theoretically grounded nor generally sufficient in practice. Building on this, we localize the source of the problem at the interface between the model's neural networks and their output probabilistic distributions. We explain a common source of instability stemming from an incautious formulation of the encoded Normal distribution's variance, and apply the same approach on other, less obvious sources. We show that by implementing small changes to the way we parameterize the Normal distributions on which they rely, VAEs can securely be trained.


Exploring Autoencoder based Error bounded Compression for Scientific Data. Error bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE based compression approaches support error bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in depth investigation of the characteristics of various autoencoder models and develop an error bounded autoencoder based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE based error bounded compression framework, fine tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100 800 improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.


Budget constrained rail electrification modeling using symmetric traffic assignment a North American case study. We consider a budget constrained rail network electrification problem with associated changes in costs of energy usage (via path gradient and curvature), operations, and long term maintenance. In particular, we consider that freight flows on such a network form a user equilibrium. Interactions between electric and diesel trains on the same corridor are represented with nonseparable link performance functions, which nevertheless have a symmetric Jacobian. This bi level formulation is solved for the North American railroad network using a genetic algorithm (GA), incorporating domain specific insights to reduce the number of solutions which must be considered. We analyze solution characteristics and decision making implications. Results show that broad connectivity would be beneficial for most impact. Increasing demand shifts electrified corridors towards the more populous east and gulf coasts, while increased operational costs results in electrification of routes through mountainous terrains.


A structure preserving finite element method for compressible ideal and resistive MHD. We construct a structure preserving finite element method and time stepping scheme for compressible barotropic magnetohydrodynamics (MHD) both in the ideal and resistive cases, and in the presence of viscosity. The method is deduced from the geometric variational formulation of the equations. It preserves the balance laws governing the evolution of total energy and magnetic helicity, and preserves mass and the constraint operatorname div B 0 to machine precision, both at the spatially and temporally discrete levels. In particular, conservation of energy and magnetic helicity hold at the discrete levels in the ideal case. It is observed that cross helicity is well conserved in our simulation in the ideal case.


Elementary Integration of Superelliptic Integrals. Consider a superelliptic integral I int P (Q S 1 k ) dx with mathbb K mathbb Q ( xi) , xi a primitive k th root of unity, P,Q,S in mathbb K x and S has simple roots and degree coprime with k . Note d the maximum of the degree of P,Q,S , h the logarithmic height of the coefficients and g the genus of y k S(x) . We present an algorithm which solves the elementary integration problem of I generically in O((kd) omega 2g 1 h g 1 ) operations.


Compiling Turing Machines into Storage Modification Machines. It is well known that Sch "onhage's Storage Modification Machines (SMM) can simulate Turing Machines (TM) since Sch "onhage's original proof of the Turing completeness of the eponymous machines. We propose a simple transformation of TM into SMM, setting the base for a straightforward TM to SMM compiler.


An Extended Galerkin analysis in finite element exterior calculus. For the Hodge Laplace equation in finite element exterior calculus, we introduce several families of discontinuous Galerkin methods in the extended Galerkin framework. For contractible domains, this framework utilizes seven fields and provides a unifying inf sup analysis with respect to all discretization and penalty parameters. It is shown that the proposed methods can be hybridized as a reduced two field formulation.


Experience Report Deep Learning based System Log Analysis for Anomaly Detection. Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and behavior understanding. Due to the large scale and complexity of modern software systems, the volume of logs has reached an unprecedented level. Consequently, for log based anomaly detection, conventional manual inspection methods or even traditional machine learning based methods become impractical, which serve as a catalyst for the rapid development of deep learning based solutions. However, there is currently a lack of rigorous comparison among the representative log based anomaly detectors that resort to neural networks. Moreover, the re implementation process demands non trivial efforts, and bias can be easily introduced. To better understand the characteristics of different anomaly detectors, in this paper, we provide a comprehensive review and evaluation of five popular neural networks used by six state of the art methods. Particularly, four of the selected methods are unsupervised, and the remaining two are supervised. These methods are evaluated with two publicly available log datasets, which contain nearly 16 million log messages and 0.4 million anomaly instances in total. We believe our work can serve as a basis in this field and contribute to future academic research and industrial applications.


An Assessment of Solvers for Algebraically Stabilized Discretizations of Convection Diffusion Reaction Equations. We consider flux corrected finite element discretizations of 3D convection dominated transport problems and assess the computational efficiency of algorithms based on such approximations. The methods under investigation include flux corrected transport schemes and monolithic limiters. We discretize in space using a continuous Galerkin method and mathbb P 1 or mathbb Q 1 finite elements. Time integration is performed using the Crank Nicolson method or an explicit strong stability preserving Runge Kutta method. Nonlinear systems are solved using a fixed point iteration method, which requires solution of large linear systems at each iteration or time step. The great variety of options in the choice of discretization methods and solver components calls for a dedicated comparative study of existing approaches. To perform such a study, we define new 3D test problems for time dependent and stationary convection diffusion reaction equations. The results of our numerical experiments illustrate how the limiting technique, time discretization and solver impact on the overall performance.


HSVI fo zs POSGs using Concavity, Convexity and Lipschitz Properties. Dynamic programming and heuristic search are at the core of state of the art solvers for sequential decision making problems. In partially observable or collaborative settings ( eg, POMDPs and Dec POMDPs), this requires introducing an appropriate statistic that induces a fully observable problem as well as bounding (convex) approximators of the optimal value function. This approach has succeeded in some subclasses of 2 player zero sum partially observable stochastic games (zs POSGs) as well, but failed in the general case despite known concavity and convexity properties, which only led to heuristic algorithms with poor convergence guarantees. We overcome this issue, leveraging on these properties to derive bounding approximators and efficient update and selection operators, before deriving a prototypical solver inspired by HSVI that provably converges to an epsilon optimal solution in finite time, and which we empirically evaluate. This opens the door to a novel family of promising approaches complementing those relying on linear programming or iterative methods.


Incorporating External Knowledge to Enhance Tabular Reasoning. Reasoning about tabular information presents unique challenges to modern NLP approaches which largely rely on pre trained contextualized embeddings of text. In this paper, we study these challenges through the problem of tabular natural language inference. We propose easy and effective modifications to how information is presented to a model for this task. We show via systematic experiments that these strategies substantially improve tabular inference performance.


Building Legal Datasets. Data centric AI calls for better, not just bigger, datasets. As data protection laws with extra territorial reach proliferate worldwide, ensuring datasets are legal is an increasingly crucial yet overlooked component of better''. To help dataset builders become more willing and able to navigate this complex legal space, this paper reviews key legal obligations surrounding ML datasets, examines the practical impact of data laws on ML pipelines, and offers a framework for building legal datasets.


Towards Real World Category level Articulation Pose Estimation. Human life is populated with articulated objects. Current Category level Articulation Pose Estimation (CAPE) methods are studied under the single instance setting with a fixed kinematic structure for each category. Considering these limitations, we reform this problem setting for real world environments and suggest a CAPE Real (CAPER) task setting. This setting allows varied kinematic structures within a semantic category, and multiple instances to co exist in an observation of real world. To support this task, we build an articulated model repository ReArt 48 and present an efficient dataset generation pipeline, which contains Fast Articulated Object Modeling (FAOM) and Semi Authentic MixEd Reality Technique (SAMERT). Accompanying the pipeline, we build a large scale mixed reality dataset ReArtMix and a real world dataset ReArtVal. We also propose an effective framework ReArtNOCS that exploits RGB D input to estimate part level pose for multiple instances in a single forward pass. Extensive experiments demonstrate that the proposed ReArtNOCS can achieve good performance on both CAPER and CAPE settings. We believe it could serve as a strong baseline for future research on the CAPER task.


The commutator subgroups of free groups and surface groups. A beautifully simple free generating set for the commutator subgroup of a free group was constructed by Tomaszewski. We give a new geometric proof of his theorem, and show how to give a similar free generating set for the commutator subgroup of a surface group. We also give a simple representation theoretic description of the structure of the abelianizations of these commutator subgroups and calculate their homology.


On the Jones Polynomial. This expository essay is aimed at introducing the Jones polynomial. We will see the encapsulation of the Jones polynomial, which will involve topics in functional analysis and geometrical topology making this essay an interdisciplinary area of mathematics. The presentation is based on a lot of different sources of material (check references), but we will mainly be giving an account on Jones' papers and Kauffman's papers.


Uncertainty Based Offline Reinforcement Learning with Diversified Q Ensemble. Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out of distribution (OOD) data points. To this end, offline RL algorithms adopt either a constraint or a penalty term that explicitly guides the policy to stay close to the given dataset. However, prior methods typically require accurate estimation of the behavior policy or sampling from OOD data points, which themselves can be a non trivial problem. Moreover, these methods under utilize the generalization ability of deep neural networks and often fall into suboptimal solutions too close to the given dataset. In this work, we propose an uncertainty based offline RL method that takes into account the confidence of the Q value prediction and does not require any estimation or sampling of the data distribution. We show that the clipped Q learning, a technique widely used in online RL, can be leveraged to successfully penalize OOD data points with high prediction uncertainties. Surprisingly, we find that it is possible to substantially outperform existing offline RL methods on various tasks by simply increasing the number of Q networks along with the clipped Q learning. Based on this observation, we propose an ensemble diversified actor critic algorithm that reduces the number of required ensemble networks down to a tenth compared to the naive ensemble while achieving state of the art performance on most of the D4RL benchmarks considered.