Compound eye inspired flat lensless imaging with spatially coded Voronoi Fresnel phase. Lensless cameras are a class of imaging devices that shrink the physical dimensions to the very close vicinity of the image sensor by integrating flat optics and computational algorithms. Here we report a flat lensless camera with spatially coded Voronoi Fresnel phase, partly inspired by biological apposition compound eye, to achieve superior image quality. We propose a design principle of maximizing the information in optics to facilitate the computational reconstruction. By introducing a Fourier domain metric, Modulation Transfer Function volume (MTFv), we devise an optimization framework to guide the optimal design of the optical element. The resulting Voronoi Fresnel phase features an irregular array of quasi Centroidal Voronoi cells containing a base first order Fresnel phase function. We demonstrate and verify the imaging performance with a prototype Voronoi Fresnel lensless camera on a 1.6 megapixel image sensor in various illumination conditions. The proposed design could benefit the development of compact imaging systems working in extreme physical conditions.


How RL Agents Behave When Their Actions Are Modified. Reinforcement learning in complex environments may require supervision to prevent the agent from attempting dangerous actions. As a result of supervisor intervention, the executed action may differ from the action specified by the policy. How does this affect learning? We present the Modified Action Markov Decision Process, an extension of the MDP model that allows actions to differ from the policy. We analyze the asymptotic behaviours of common reinforcement learning algorithms in this setting and show that they adapt in different ways some completely ignore modifications while others go to various lengths in trying to avoid action modifications that decrease reward. By choosing the right algorithm, developers can prevent their agents from learning to circumvent interruptions or constraints, and better control agent responses to other kinds of action modification, like self damage.


A symmetric chain decomposition of N(m,n) of composition. A poset is called a symmetric chain decomposition if the poset can be expressed as a disjoint union of symmetric chains. For positive integers m and n , let N(m,n) denote the set of all compositions alpha ( alpha 1, cdots, alpha m) , with 0 le alpha i le n for each i 1, cdots,m . Define order as follow, forall alpha, beta in N(m,n) , beta alpha if and only if beta i le alpha i(i 1, cdots,m) and sum limits i 1 m beta i sum limits i 1 m alpha i . In this paper, we show that the poset (N(m,n), ) can be expressed as a disjoint of symmetric chains by constructive method.


Benchmarking Pedestrian Odometry The Brown Pedestrian Odometry Dataset (BPOD). We present the Brown Pedestrian Odometry Dataset (BPOD) for benchmarking visual odometry algorithms in head mounted pedestrian settings. This dataset was captured using synchronized global and rolling shutter stereo cameras in 12 diverse indoor and outdoor locations on Brown University's campus. Compared to existing datasets, BPOD contains more image blur and self rotation, which are common in pedestrian odometry but rare elsewhere. Ground truth trajectories are generated from stick on markers placed along the pedestrian's path, and the pedestrian's position is documented using a third person video. We evaluate the performance of representative direct, feature based, and learning based VO methods on BPOD. Our results show that significant development is needed to successfully capture pedestrian trajectories. The link to the dataset is here url https doi.org 10.26300 c1n7 7p93


Symplectic Learning for Hamiltonian Neural Networks. Machine learning methods are widely used in the natural sciences to model and predict physical systems from observation data. Yet, they are often used as poorly understood "black boxes," disregarding existing mathematical structure and invariants of the problem. Recently, the proposal of Hamiltonian Neural Networks (HNNs) took a first step towards a unified "gray box" approach, using physical insight to improve performance for Hamiltonian systems. In this paper, we explore a significantly improved training method for HNNs, exploiting the symplectic structure of Hamiltonian systems with a different loss function. This frees the loss from an artificial lower bound. We mathematically guarantee the existence of an exact Hamiltonian function which the HNN can learn. This allows us to prove and numerically analyze the errors made by HNNs which, in turn, renders them fully explainable. Finally, we present a novel post training correction to obtain the true Hamiltonian only from discretized observation data, up to an arbitrary order.


Concept and Attribute Reduction Based on Rectangle Theory of Formal Concept. Based on rectangle theory of formal concept and set covering theory, the concept reduction preserving binary relations is investigated in this paper. It is known that there are three types of formal concepts core concepts, relative necessary concepts and unnecessary concepts. First, we present the new judgment results for relative necessary concepts and unnecessary concepts. Second, we derive the bounds for both the maximum number of relative necessary concepts and the maximum number of unnecessary concepts and it is a difficult problem as either in concept reduction preserving binary relations or attribute reduction of decision formal contexts, the computation of formal contexts from formal concepts is a challenging problem. Third, based on rectangle theory of formal concept, a fast algorithm for reducing attributes while preserving the extensions for a set of formal concepts is proposed using the extension bit array technique, which allows multiple context cells to be processed by a single 32 bit or 64 bit operator. Technically, the new algorithm could store both formal context and extent of a concept as bit arrays, and we can use bit operations to process set operations "or" as well as "and". One more merit is that the new algorithm does not need to consider other concepts in the concept lattice, thus the algorithm is explicit to understand and fast. Experiments demonstrate that the new algorithm is effective in the computation of attribute reductions.


Interpretable and Fair Boolean Rule Sets via Column Generation. This paper considers the learning of Boolean rules in either disjunctive normal form (DNF, OR of ANDs, equivalent to decision rule sets) or conjunctive normal form (CNF, AND of ORs) as an interpretable model for classification. An integer program is formulated to optimally trade classification accuracy for rule simplicity. We also consider the fairness setting and extend the formulation to include explicit constraints on two different measures of classification parity equality of opportunity and equalized odds. Column generation (CG) is used to efficiently search over an exponential number of candidate clauses (conjunctions or disjunctions) without the need for heuristic rule mining. This approach also bounds the gap between the selected rule set and the best possible rule set on the training data. To handle large datasets, we propose an approximate CG algorithm using randomization. Compared to three recently proposed alternatives, the CG algorithm dominates the accuracy simplicity trade off in 8 out of 16 datasets. When maximized for accuracy, CG is competitive with rule learners designed for this purpose, sometimes finding significantly simpler solutions that are no less accurate. Compared to other fair and interpretable classifiers, our method is able to find rule sets that meet stricter notions of fairness with a modest trade off in accuracy.


A novel hybrid methodology of measuring sentence similarity. The problem of measuring sentence similarity is an essential issue in the natural language processing (NLP) area. It is necessary to measure the similarity between sentences accurately. There are many approaches to measuring sentence similarity. Deep learning methodology shows a state of the art performance in many natural language processing fields and is used a lot in sentence similarity measurement methods. However, in the natural language processing field, considering the structure of the sentence or the word structure that makes up the sentence is also important. In this study, we propose a methodology combined with both deep learning methodology and a method considering lexical relationships. Our evaluation metric is the Pearson correlation coefficient and Spearman correlation coefficient. As a result, the proposed method outperforms the current approaches on a KorSTS standard benchmark Korean dataset. Moreover, it performs a maximum of 65 increase than only using deep learning methodology. Experiments show that our proposed method generally results in better performance than those with only a deep learning model.


Reversing orientation homeomorphisms of surfaces. Let M be a connected compact orientable surface, f M to mathbb R be a Morse function, and h M to M be a diffeomorphism which preserves f in the sense that f circ h f . We will show that if h leaves invariant each regular component of each level set of f and reverses its orientation, then h 2 is isotopic to the identity map of M via f preserving isotopy. This statement can be regarded as a foliated and a homotopy analogue of a well known observation that every reversing orientation orthogonal isomorphism of a plane has order 2 , i.e. is a mirror symmetry with respect to some line. The obtained results hold in fact for a larger class of maps with isolated singularities from connected compact orientable surfaces to the real line and the circle.


DeepTaskAPT Insider APT detection using Task tree based Deep Learning. APT, known as Advanced Persistent Threat, is a difficult challenge for cyber defence. These threats make many traditional defences ineffective as the vulnerabilities exploited by these threats are insiders who have access to and are within the network. This paper proposes DeepTaskAPT, a heterogeneous task tree based deep learning method to construct a baseline model based on sequences of tasks using a Long Short Term Memory (LSTM) neural network that can be applied across different users to identify anomalous behaviour. Rather than applying the model to sequential log entries directly, as most current approaches do, DeepTaskAPT applies a process tree based task generation method to generate sequential log entries for the deep learning model. To assess the performance of DeepTaskAPT, we use a recently released synthetic dataset, DARPA Operationally Transparent Computing (OpTC) dataset and a real world dataset, Los Alamos National Laboratory (LANL) dataset. Both of them are composed of host based data collected from sensors. Our results show that DeepTaskAPT outperforms similar approaches e.g. DeepLog and the DeepTaskAPT baseline model demonstrate its capability to detect malicious traces in various attack scenarios while having high accuracy and low false positive rates. To the best of knowledge this is the very first attempt of using recently introduced OpTC dataset for cyber threat detection.


A Robotic Model of Hippocampal Reverse Replay for Reinforcement Learning. Hippocampal reverse replay is thought to contribute to learning, and particularly reinforcement learning, in animals. We present a computational model of learning in the hippocampus that builds on a previous model of the hippocampal striatal network viewed as implementing a three factor reinforcement learning rule. To augment this model with hippocampal reverse replay, a novel policy gradient learning rule is derived that associates place cell activity with responses in cells representing actions. This new model is evaluated using a simulated robot spatial navigation task inspired by the Morris water maze. Results show that reverse replay can accelerate learning from reinforcement, whilst improving stability and robustness over multiple trials. As implied by the neurobiological data, our study implies that reverse replay can make a significant positive contribution to reinforcement learning, although learning that is less efficient and less stable is possible in its absence. We conclude that reverse replay may enhance reinforcement learning in the mammalian hippocampal striatal system rather than provide its core mechanism.


A Rado theorem for complex spaces. We generalize Rado's extension theorem to complex spaces.


On the dynamics of nano frames. In this paper, size dependent dynamic responses of small size frames are modelled by stress driven nonlocal elasticity and assessed by a consistent finite element methodology. Starting from uncoupled axial and bending differential equations, the exact dynamic stiffness matrix of a two node stress driven nonlocal beam element is evaluated in a closed form. The relevant global dynamic stiffness matrix of an arbitrarily shaped small size frame, where every member is made of a single element, is built by a standard finite element assembly procedure. The Wittrick Williams algorithm is applied to calculate natural frequencies and modes. The developed methodology, exploiting the one conceived for straight beams in International Journal of Engineering Science 115, 14 27 (2017) , is suitable for investigating size dependent free vibrations of small size systems of current applicative interest in Nano Engineering, such as carbon nanotube networks and polymer metal micro trusses.


Multi Agent Semi Siamese Training for Long tail and Shallow Face Learning. With the recent development of deep convolutional neural networks and large scale datasets, deep face recognition has made remarkable progress and been widely used in various applications. However, unlike the existing public face datasets, in many real world scenarios of face recognition, the depth of training dataset is shallow, which means only two face images are available for each ID. With the non uniform increase of samples, such issue is converted to a more general case, a.k.a long tail face learning, which suffers from data imbalance and intra class diversity dearth simultaneously. These adverse conditions damage the training and result in the decline of model performance. Based on the Semi Siamese Training (SST), we introduce an advanced solution, named Multi Agent Semi Siamese Training (MASST), to address these problems. MASST includes a probe network and multiple gallery agents, the former aims to encode the probe features, and the latter constitutes a stack of networks that encode the prototypes (gallery features). For each training iteration, the gallery network, which is sequentially rotated from the stack, and the probe network form a pair of semi siamese networks. We give the theoretical and empirical analysis that, given the long tail (or shallow) data and training loss, MASST smooths the loss landscape and satisfies the Lipschitz continuity with the help of multiple agents and the updating gallery queue. The proposed method is out of extra dependency, thus can be easily integrated with the existing loss functions and network architectures. It is worth noting that, although multiple gallery agents are employed for training, only the probe network is needed for inference, without increasing the inference cost. Extensive experiments and comparisons demonstrate the advantages of MASST for long tail and shallow face learning.


The graphs with a symmetrical Euler cycle. The edges surrounding a face of a map M form a cycle C , called the boundary cycle of the face, and C is often not a simple cycle. If the map M is arc transitive, then there is a cyclic subgroup of automorphisms of M which leaves C invariant and is bi regular on the edges of the induced subgraph C that is to say, C is a symmetrical Euler cycle of C . In this paper we determine the family of graphs (which may have multiple edges) whose edge sets can be sequenced to form a symmetrical Euler cycle. We first classify all graphs which have a cyclic subgroup of automorphisms acting bi regularly on edges. We then apply this classification to obtain the graphs possessing a symmetrical Euler cycle, and therefore are the (only) candidates for the induced subgraphs of the boundary cycles of the faces of arc transitive maps.


Exploring Adversarial Robustness of Deep Metric Learning. Deep Metric Learning (DML), a widely used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is small while dissimilar ones are far apart. Although the underlying neural networks produce good accuracy on naturally occurring samples, they are vulnerable to adversarially perturbed samples that reduce performance. We take a first step towards training robust DML models and tackle the primary challenge of the metric losses being dependent on the samples in a mini batch, unlike standard losses that only depend on the specific input output pair. We analyze this dependence effect and contribute a robust optimization formulation. Using experiments on three commonly used DML datasets, we demonstrate 5 76 fold increases in adversarial accuracy, and outperform an existing DML model that sought out to be robust.


Duration Squeezing Aware Communication and Computing for Proactive VR. Proactive tile based virtual reality video streaming computes and delivers the predicted tiles to be requested before playback. All existing works overlook the important fact that computing and communication (CC) tasks for a segment may squeeze the time for the tasks for the next segment, which will cause less and less available time for the latter segments. In this paper, we jointly optimize the durations for CC tasks to maximize the completion rate of CC tasks under the task duration squeezing aware constraint. To ensure the latter segments remain enough time for the tasks, the CC tasks for a segment are not allowed to squeeze the time for computing and delivering the subsequent segment. We find the closed form optimal solution, from which we find a minimum resource limited, an unconditional and a conditional resource tradeoff regions, which are determined by the total time for proactive CC tasks and the playback duration of a segment. Owing to the duration squeezing prohibited constraints, the increase of the configured resources may not be always useful for improving the completion rate of CC tasks. Numerical results validate the impact of the duration squeezing prohibited constraints and illustrate the three regions.


On Convolutional Precoding in PAC Codes. Polarization adjusted convolutional (PAC) codes are special concatenated codes in which we employ a one to one convolutional transform as a precoding step before the polar transform. In this scheme, the polar transform (as a mapper) and the successive cancellation process (as a demapper) present a synthetic vector channel to the convolutional transformation. The numerical results in the literature show that this concatenation improves the weight distribution of polar codes which justifies the superior error correction performance of PAC codes relative to polar codes. In this work, we explicitly show why the convolutional precoding reduces the number of minimumweight codewords. Further analysis exhibits where the precoding stage is not effective. Then, we recognize weaknesses of the convolutional precoding which are unequal error protection (UEP) of the information bits due to rate profiling and lack of cross segmental convolution. Finally, we assess the possibility of improving the precoding stage by proposing some irregular convolutional precodings.


Target Detection and Segmentation in Circular Scan Synthetic Aperture Sonar Images using Semi Supervised Convolutional Encoder Decoders. We propose a framework for saliency based, multi target detection and segmentation of circular scan, synthetic aperture sonar (CSAS) imagery. Our framework relies on a multi branch, convolutional encoder decoder network (MB CEDN). The encoder portion of the MB CEDN extracts visual contrast features from CSAS images. These features are fed into dual decoders that perform pixel level segmentation to mask targets. Each decoder provides different perspectives as to what constitutes a salient target. These opinions are aggregated and cascaded into a deep parsing network to refine the segmentation. We evaluate our framework using real world CSAS imagery consisting of five broad target classes. We compare against existing approaches from the computer vision literature. We show that our framework outperforms supervised, deep saliency networks designed for natural imagery. It greatly outperforms unsupervised saliency approaches developed for natural imagery. This illustrates that natural image based models may need to be altered to be effective for this imaging sonar modality.


Mix3D Out of Context Data Augmentation for 3D Scenes. We present Mix3D, a data augmentation technique for segmenting large scale 3D scenes. Since scene context helps reasoning about object semantics, current works focus on models with large capacity and receptive fields that can fully capture the global context of an input 3D scene. However, strong contextual priors can have detrimental implications like mistaking a pedestrian crossing the street for a car. In this work, we focus on the importance of balancing global scene context and local geometry, with the goal of generalizing beyond the contextual priors in the training set. In particular, we propose a "mixing" technique which creates new training samples by combining two augmented scenes. By doing so, object instances are implicitly placed into novel out of context environments and therefore making it harder for models to rely on scene context alone, and instead infer semantics from local structure as well. We perform detailed analysis to understand the importance of global context, local structures and the effect of mixing scenes. In experiments, we show that models trained with Mix3D profit from a significant performance boost on indoor (ScanNet, S3DIS) and outdoor datasets (SemanticKITTI). Mix3D can be trivially used with any existing method, e.g., trained with Mix3D, MinkowskiNet outperforms all prior state of the art methods by a significant margin on the ScanNet test benchmark 78.1 mIoU. Code is available at https nekrasov.dev mix3d


Intermittency and multiscaling in limit theorems. It has been recently discovered that some random processes may satisfy limit theorems even though they exhibit intermittency, namely an unusual growth of moments. In this paper we provide a deeper understanding of these intricate limiting phenomena. We show that intermittent processes may exhibit a multiscale behavior involving growth at different rates. To these rates correspond different scales. In addition to a dominant scale, intermittent processes may exhibit secondary scales. The probability of these scales decreases to zero as a power function of time. For the analysis, we consider large deviations of the rate of growth of the processes. Our approach is quite general and covers different possible scenarios with special focus on the so called supOU processes.


Beyond Tracking Using Deep Learning to Discover Novel Interactions in Biological Swarms. Most deep learning frameworks for understanding biological swarms are designed to fit perceptive models of group behavior to individual level data (e.g., spatial coordinates of identified features of individuals) that have been separately gathered from video observations. Despite considerable advances in automated tracking, these methods are still very expensive or unreliable when tracking large numbers of animals simultaneously. Moreover, this approach assumes that the human chosen features include sufficient features to explain important patterns in collective behavior. To address these issues, we propose training deep network models to predict system level states directly from generic graphical features from the entire view, which can be relatively inexpensive to gather in a completely automated fashion. Because the resulting predictive models are not based on human understood predictors, we use explanatory modules (e.g., Grad CAM) that combine information hidden in the latent variables of the deep network model with the video data itself to communicate to a human observer which aspects of observed individual behaviors are most informative in predicting group behavior. This represents an example of augmented intelligence in behavioral ecology knowledge co creation in a human AI team. As proof of concept, we utilize a 20 day video recording of a colony of over 50 Harpegnathos saltator ants to showcase that, without any individual annotations provided, a trained model can generate an "importance map" across the video frames to highlight regions of important behaviors, such as dueling (which the AI has no a priori knowledge of), that play a role in the resolution of reproductive hierarchy re formation. Based on the empirical results, we also discuss the potential use and current challenges.


FLASH 1.0 A Software Framework for Rapid Parallel Deployment and Enhancing Host Code Portability in Heterogeneous Computing. In this paper, we present FLASH 1.0, a C based software framework for rapid parallel deployment and enhancing host code portability in heterogeneous computing. FLASH takes a novel approach in describing kernels and dynamically dispatching them in a hardware agnostic manner. FLASH features truly hardware agnostic frontend interfaces, which not only unify the compile time control flow but also enforces a portability optimized code organization that imposes a demarcation between computational (performance critical) and functional (non performance critical) codes as well as the separation of hardware specific and hardware agnostic codes in the host application. We use static code analysis to measure the hardware independence ratio of popular HPC applications and show that up to 99.72 code portability can be achieved with FLASH. Similarly, we measure the complexity of state of the art portable programming models and show that a code reduction of up to 2.2x can be achieved for two common HPC kernels while maintaining 100 code portability with a normalized framework overhead between 1 13 of the total kernel runtime. The codes are available at https github.com PSCLab ASU FLASH.


Towards Modelling Coherence in Spoken Discourse. While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the coherence in text, coherence in spoken discourse is also dependent on the prosodic and acoustic patterns in speech. In this paper, we model coherence in spoken discourse with audio based coherence models. We perform experiments with four coherence related tasks with spoken discourses. In our experiments, we evaluate machine generated speech against the speech delivered by expert human speakers. We also compare the spoken discourses generated by human language learners of varying language proficiency levels. Our results show that incorporating the audio modality along with the text benefits the coherence models in performing downstream coherence related tasks with spoken discourses.


ARTH Algorithm For Reading Text Handily An AI Aid for People having Word Processing Issues. The objective of this project is to solve one of the major problems faced by the people having word processing issues like trauma, or mild mental disability. "ARTH" is the short form of Algorithm for Reading Handily. ARTH is a self learning set of algorithms that is an intelligent way of fulfilling the need for "reading and understanding the text effortlessly" which adjusts according to the needs of every user. The research project propagates in two steps. In the first step, the algorithm tries to identify the difficult words present in the text based on two features the number of syllables and usage frequency using a clustering algorithm. After the analysis of the clusters, the algorithm labels these clusters, according to their difficulty level. In the second step, the algorithm interacts with the user. It aims to test the user's comprehensibility of the text and his her vocabulary level by taking an automatically generated quiz. The algorithm identifies the clusters which are difficult for the user, based on the result of the analysis. The meaning of perceived difficult words is displayed next to them. The technology "ARTH" focuses on the revival of the joy of reading among those people, who have a poor vocabulary or any word processing issues.


Synthesising Multi Modal Minority Samples for Tabular Data. Real world binary classification tasks are in many cases imbalanced, where the minority class is much smaller than the majority class. This skewness is challenging for machine learning algorithms as they tend to focus on the majority and greatly misclassify the minority. Adding synthetic minority samples to the dataset before training the model is a popular technique to address this difficulty and is commonly achieved by interpolating minority samples. Tabular datasets are often multi modal and contain discrete (categorical) features in addition to continuous ones which makes interpolation of samples non trivial. To address this, we propose a latent space interpolation framework which (1) maps the multi modal samples to a dense continuous latent space using an autoencoder (2) applies oversampling by interpolation in the latent space and (3) maps the synthetic samples back to the original feature space. We defined metrics to directly evaluate the quality of the minority data generated and showed that our framework generates better synthetic data than the existing methods. Furthermore, the superior synthetic data yields better prediction quality in downstream binary classification tasks, as was demonstrated in extensive experiments with 27 publicly available real world datasets


On the forward dynamical behavior of nonautonomous lattice dynamical systems. In this article, we study the forward dynamical behavior of nonautonomous lattice systems. We first construct a family of sets mathcal A varepsilon( sigma) sigma in Sigma in arbitrary small neighborhood of a global attractor of the skew product flow generated by a general nonautonomous lattice system, which is forward invariant and uniformly forward attracts any bounded subset of the phase space. Moreover, under some suitable conditions, we further construct a family of sets mathcal B varepsilon( sigma) sigma in Sigma such that it uniformly forward exponentially attracts bounded subsets of the phase space. As an application, we study the discrete Gray Scott model in detail and illustrate how to apply our abstract results to some concrete lattice system.


VoterFraud2020 a Multi modal Dataset of Election Fraud Claims on Twitter. The wide spread of unfounded election fraud claims surrounding the U.S. 2020 election had resulted in undermining of trust in the election, culminating in violence inside the U.S. capitol. Under these circumstances, it is critical to understand the discussions surrounding these claims on Twitter, a major platform where the claims were disseminated. To this end, we collected and released the VoterFraud2020 dataset, a multi modal dataset with 7.6M tweets and 25.6M retweets from 2.6M users related to voter fraud claims. To make this data immediately useful for a diverse set of research projects, we further enhance the data with cluster labels computed from the retweet graph, each user's suspension status, and the perceptual hashes of tweeted images. The dataset also includes aggregate data for all external links and YouTube videos that appear in the tweets. Preliminary analyses of the data show that Twitter's user suspension actions mostly affected a specific community of voter fraud claim promoters, and exposes the most common URLs, images and YouTube videos shared in the data.


Complex Hyperbolic Triangle Groups of Type m,m,0 n 1, n 2, 2 . In this paper we study the discreteness of complex hyperbolic triangle groups of type m,m,0 n 1, n 2, 2 , i.e. groups of isometries of the complex hyperbolic plane generated by three complex reflections of orders n 1, n 2, 2 in complex geodesics with pairwise distances m, m, 0 . For fixed m , the parameter space of such groups is of real dimension one. We determine the possible orders for n 1 and n 2 and also intervals in the parameter space that correspond to discrete and non discrete triangle groups.


Object DGCNN 3D Object Detection using Dynamic Graphs. 3D object detection often involves complicated training and testing pipelines, which require substantial domain knowledge about individual datasets. Inspired by recent non maximum suppression free 2D object detection models, we propose a 3D object detection architecture on point clouds. Our method models 3D object detection as message passing on a dynamic graph, generalizing the DGCNN framework to predict a set of objects. In our construction, we remove the necessity of post processing via object confidence aggregation or non maximum suppression. To facilitate object detection from sparse point clouds, we also propose a set to set distillation approach customized to 3D detection. This approach aligns the outputs of the teacher model and the student model in a permutation invariant fashion, significantly simplifying knowledge distillation for the 3D detection task. Our method achieves state of the art performance on autonomous driving benchmarks. We also provide abundant analysis of the detection model and distillation framework.


Synthesizing Optimal Parallelism Placement and Reduction Strategies on Hierarchical Systems for Deep Learning. We present a novel characterization of the mapping of multiple parallelism forms (e.g. data and model parallelism) onto hierarchical accelerator systems that is hierarchy aware and greatly reduces the space of software to hardware mapping. We experimentally verify the substantial effect of these mappings on all reduce performance (up to 448x). We offer a novel syntax guided program synthesis framework that is able to decompose reductions over one or more parallelism axes to sequences of collectives in a hierarchy and mapping aware way. For 69 of parallelism placements and user requested reductions, our framework synthesizes programs that outperform the default all reduce implementation when evaluated on different GPU hierarchies (max 2.04x, average 1.27x). We complement our synthesis tool with a simulator exceeding 90 top 10 accuracy, which therefore reduces the need for massive evaluations of synthesis results to determine a small set of optimal programs and mappings.


Pixel Contrastive Consistent Semi Supervised Semantic Segmentation. We present a novel semi supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities the label space consistency property between image augmentations and the feature space contrastive property among different pixels. We leverage the pixel level L2 loss and the pixel contrastive loss for the two purposes respectively. To address the computational efficiency issue and the false negative noise issue involved in the pixel contrastive loss, we further introduce and investigate several negative sampling techniques. Extensive experiments demonstrate the state of the art performance of our method (PC2Seg) with the DeepLab v3 architecture, in several challenging semi supervised settings derived from the VOC, Cityscapes, and COCO datasets.


Improving Adversarial Robustness via Channel wise Activation Suppressing. The study of adversarial examples and their activation has attracted significant attention for secure and robust learning with deep neural networks (DNNs). Different from existing works, in this paper, we highlight two new characteristics of adversarial examples from the channel wise activation perspective 1) the activation magnitudes of adversarial examples are higher than that of natural examples and 2) the channels are activated more uniformly by adversarial examples than natural examples. We find that the state of the art defense adversarial training has addressed the first issue of high activation magnitudes via training on adversarial examples, while the second issue of uniform activation remains. This motivates us to suppress redundant activation from being activated by adversarial perturbations via a Channel wise Activation Suppressing (CAS) strategy. We show that CAS can train a model that inherently suppresses adversarial activation, and can be easily applied to existing defense methods to further improve their robustness. Our work provides a simple but generic training strategy for robustifying the intermediate layer activation of DNNs.


Resilient Nash Equilibrium Seeking in the Partial Information Setting. Current research in distributed Nash equilibrium (NE) seeking in the partial information setting assumes that information is exchanged between agents that are "truthful". However, in general noncooperative games agents may consider sending misinformation to neighboring agents with the goal of further reducing their cost. Additionally, communication networks are vulnerable to attacks from agents outside the game as well as communication failures. In this paper, we propose a distributed NE seeking algorithm that is robust against adversarial agents that transmit noise, random signals, constant singles, deceitful messages, as well as being resilient to external factors such as dropped communication, jammed signals, and man in the middle attacks. The core issue that makes the problem challenging is that agents have no means of verifying if the information they receive is correct, i.e. there is no "ground truth". To address this problem, we use an observation graph, that gives truthful action information, in conjunction with a communication graph, that gives (potentially incorrect) information. By filtering information obtained from these two graphs, we show that our algorithm is resilient against adversarial agents and converges to the Nash equilibrium.


Multi Scale Single Image Dehazing Using Laplacian and Gaussian Pyramids. Model driven single image dehazing was widely studied on top of different priors due to its extensive applications. Ambiguity between object radiance and haze and noise amplification in sky regions are two inherent problems of model driven single image dehazing. In this paper, a dark direct attenuation prior (DDAP) is proposed to address the former problem. A novel haze line averaging is proposed to reduce the morphological artifacts caused by the DDAP which enables a weighted guided image filter with a smaller radius to further reduce the morphological artifacts while preserve the fine structure in the image. A multi scale dehazing algorithm is then proposed to address the latter problem by adopting Laplacian and Guassian pyramids to decompose the hazy image into different levels and applying different haze removal and noise reduction approaches to restore the scene radiance at different levels of the pyramid. The resultant pyramid is collapsed to restore a haze free image. Experiment results demonstrate that the proposed algorithm outperforms state of the art dehazing algorithms and the noise is indeed prevented from being amplified in the sky region.


A Ternary Bi Directional LSTM Classification for Brain Activation Pattern Recognition Using fNIRS. Functional near infrared spectroscopy (fNIRS) is a non invasive, low cost method used to study the brain's blood flow pattern. Such patterns can enable us to classify performed by a subject. In recent research, most classification systems use traditional machine learning algorithms for the classification of tasks. These methods, which are easier to implement, usually suffer from low accuracy. Further, a complex pre processing phase is required for data preparation before implementing traditional machine learning methods. The proposed system uses a Bi Directional LSTM based deep learning architecture for task classification, including mental arithmetic, motor imagery, and idle state using fNIRS data. Further, this system will require less pre processing than the traditional approach, saving time and computational resources while obtaining an accuracy of 81.48 , which is considerably higher than the accuracy obtained using conventional machine learning algorithms for the same data set.


Ion dynamics driven by a strongly nonlinear plasma wake. In plasma wakefield accelerators, the wave excited in the plasma eventually breaks and leaves behind slowly changing fields and currents that perturb the ion density background. We study this process numerically using the example of a FACET experiment where the wave is excited by an electron bunch in the bubble regime in a radially bounded plasma. Four physical effects underlie the dynamics of ions (1) attraction of ions toward the axis by the fields of the driver and the wave, resulting in formation of a density peak, (2) generation of ion acoustic solitons following the decay of the density peak, (3) positive plasma charging after wave breaking, leading to acceleration of some ions in the radial direction, and (4) plasma pinching by the current generated during the wavebreaking. Interplay of these effects result in formation of various radial density profiles, which are difficult to produce in any other way


A Reference Model for IoT Embodied Agents Controlled by Neural Networks. Embodied agents is a term used to denote intelligent agents, which are a component of devices belonging to the Internet of Things (IoT) domain. Each agent is provided with sensors and actuators to interact with the environment, and with a 'controller' that usually contains an artificial neural network (ANN). In previous publications, we introduced three software approaches to design, implement and test IoT embodied agents. In this paper, we propose a reference model based on statecharts that offers abstractions tailored to the development of IoT applications. The model represents embodied agents that are controlled by neural networks. Our model includes the ANN training process, represented as a reconfiguration step such as changing agent features or neural net connections. Our contributions include the identification of the main characteristics of IoT embodied agents, a reference model specification based on statecharts, and an illustrative application of the model to support autonomous street lights. The proposal aims to support the design and implementation of IoT applications by providing high level design abstractions and models, thus enabling the designer to have a uniform approach to conceiving, designing and explaining such applications.


Decomposing spatial mode superpositions with a triangular optical cavity. We demonstrate that a triangular cavity can operate as an efficient discriminator for Hermite Gaussian optical modes. The process is applied to distinct fields produced by a Spatial Light Modulator, decomposing the generated paraxial field onto a basis of modes defined by the resonant modes of the optical cavity. We also present a proposal for the realization of a mode sorter based on a sequence of these cavities, without the need for optical isolation. We discuus its possible applications in sensitive measurements and distribution of information in optical systems. The high purity of the process should enable the use at the level of quantum information sharing.


Systematically reviewing the layered architectural pattern principles and their use to reconstruct software architectures. Architectural reconstruction is a reverse engineering activity aiming at recovering the missing decisions on a system. It can help identify the components, within a legacy software application, according to the application's architectural pattern. It is useful to identify architectural technical debt. We are interested in identifying layers within a layered application since the layered pattern is one of the most used patterns to structure large systems. Earlier component reconstruction work focusing on that pattern relied on generic component identification criteria, such as cohesion and coupling. Recent work has identified architectural pattern specific criteria to identify components within that pattern. However, the architectural pattern specific criteria that the layered pattern embodies are loosely defined. In this paper, we present a first systematic literature review (SLR) of the literature aiming at inventorying such criteria for layers within legacy applications and grouping them under four principles that embody the fundamental design principles under lying the architectural pattern. We identify six such criteria in the form of design rules. We also perform a second systematic literature review to synthesize the literature on software architecture reconstruction in the light of these criteria. We report those principles, the rules they encompass, their representation, and their usage in software architecture reconstruction.


On Asymptotic Log Optimal Buy and Hold Strategy. In this paper, we consider a frequency based portfolio optimization problem with m geq 2 assets when the expected logarithmic growth (ELG) rate of wealth is used as the performance metric. With the aid of the notion called dominant asset, it is known that the optimal ELG level is achieved by investing all available funds on that asset. However, such an "all in" strategy is arguably too risky to implement in practice. Motivated by this issue, we study the case where the portfolio weights are chosen in a rather ad hoc manner and a buy and hold strategy is subsequently used. Then we show that, if the underlying portfolio contains a dominant asset, buy and hold on that specific asset is asymptotically log optimal with a sublinear rate of convergence. This result also extends to the scenario where a trader either does not have a probabilistic model for the returns or does not trust a model obtained from historical data. To be more specific, we show that if a market contains a dominant asset, buy and hold a market portfolio involving nonzero weights for each asset is asymptotically log optimal. Additionally, this paper also includes a conjecture regarding the property called high frequency maximality. That is, in the absence of transaction costs, high frequency rebalancing is unbeatable in the ELG sense. Support for the conjecture, involving a lemma for a weak version of the conjecture, is provided. This conjecture, if true, enables us to improve the log optimality result obtained previously. Finally, a result that indicates a way regarding an issue about when should one to rebalance their portfolio if needed, is also provided. Examples, some involving simulations with historical data, are also provided along the way to illustrate the theory.


Opportunities and challenges of Blockchain Oriented systems in the tourism industry. The tourism industry is increasingly influenced by the evolution of information and communication technologies (ICT), which are revolutionizing the way people travel. In this work we want to nvestigate the use of innovative IT technologies by DMOs (Destination Management Organizations), focusing on blockchain technology, both from the point of view of research in the field, and in the study of the most relevant software projects. In particular, we intend to verify the benefits offered by these IT tools in the management and monitoring of a destination, without forgetting the implications for the other stakeholders involved. These technologies, in fact, can offer a wide range of services that can be useful throughout the life cycle of the destination.


Valuation of electricity storage contracts using the COS method. Storage of electricity has become increasingly important, due to the gradual replacement of fossil fuels by more variable and uncertain renewable energy sources. In this paper, we provide details on how to mathematically formalize a corresponding electricity storage contract, taking into account the physical limitations of a storage facility and the operational constraints of the electricity grid. We give details of a valuation technique to price these contracts, where the electricity prices follow a structural model based on a stochastic polynomial process. In particular, we show that the Fourier based COS method can be used to price the contracts accurately and efficiently.


Dynamical Analysis of the EIP 1559 Ethereum Fee Market. Participation in permissionless blockchains results in competition over system resources, which needs to be controlled with fees. Ethereum's current fee mechanism is implemented via a first price auction that results in unpredictable fees as well as other inefficiencies. EIP 1559 is a recent, improved proposal that introduces a number of innovative features such as a dynamically adaptive base fee that is burned, instead of being paid to the miners. Despite intense interest in understanding its properties, several basic questions such as whether and under what conditions does this protocol self stabilize have remained elusive thus far. We perform a thorough analysis of the resulting fee market dynamic mechanism via a combination of tools from game theory and dynamical systems. We start by providing bounds on the step size of the base fee update rule that suffice for global convergence to equilibrium via Lyapunov arguments. In the negative direction, we show that for larger step sizes instability and even formally chaotic behavior are possible under a wide range of settings. We complement these qualitative results with quantitative bounds on the resulting range of base fees. We conclude our analysis with a thorough experimental case study that corroborates our theoretical findings.


Augmenting Convolutional networks with attention based aggregation. We show how to augment any convolutional network with an attention based global map to achieve non local reasoning. We replace the final average pooling by an attention based aggregation layer akin to a single transformer block, that weights how the patches are involved in the classification decision. We plug this learned aggregation layer with a simplistic patch based convolutional network parametrized by 2 parameters (width and depth). In contrast with a pyramidal design, this architecture family maintains the input patch resolution across all the layers. It yields surprisingly competitive trade offs between accuracy and complexity, in particular in terms of memory consumption, as shown by our experiments on various computer vision tasks object classification, image segmentation and detection.


RINDNet Edge Detection for Discontinuity in Reflectance, Illumination, Normal and Depth. As a fundamental building block in computer vision, edges can be categorised into four types according to the discontinuity in surface Reflectance, Illumination, surface Normal or Depth. While great progress has been made in detecting generic or individual types of edges, it remains under explored to comprehensively study all four edge types together. In this paper, we propose a novel neural network solution, RINDNet, to jointly detect all four types of edges. Taking into consideration the distinct attributes of each type of edges and the relationship between them, RINDNet learns effective representations for each of them and works in three stages. In stage I, RINDNet uses a common backbone to extract features shared by all edges. Then in stage II it branches to prepare discriminative features for each edge type by the corresponding decoder. In stage III, an independent decision head for each type aggregates the features from previous stages to predict the initial results. Additionally, an attention module learns attention maps for all types to capture the underlying relations between them, and these maps are combined with initial results to generate the final edge detection results. For training and evaluation, we construct the first public benchmark, BSDS RIND, with all four types of edges carefully annotated. In our experiments, RINDNet yields promising results in comparison with state of the art methods. Additional analysis is presented in supplementary material.


Experimental observation of the elastic range scaling in turbulent flow with polymer additives. Minute amount of long chain flexible polymer dissolved in a turbulent flow can drastically change flow properties, such as reducing the drag and enhancing mixing. One fundamental riddle is how these polymer additives interact with the eddies of different spatial scales existing in the turbulent flow and in turn alter the turbulence energy transfer. Here we show how turbulent kinetic energy is transferred through deferent scales in the presence of the polymer additives. In particular, we observed experimentally the emerging of a new scaling range, referred to as the elastic range, where increasing amount of energy is transferred by the elasticity of the polymers. In addition, the existence of the elastic range prescribes the scaling of high order velocity statistics. Our findings have important implications to many turbulence systems such as turbulence in plasmas or superfluids where interaction between turbulent eddies and other nonlinear physical mechanisms are often involved.


Permutation Invariant Variational Autoencoder for Graph Level Representation Learning. Recently, there has been great success in applying deep neural networks on graph structured data. Most work, however, focuses on either node or graph level supervised learning, such as node, link or graph classification or node level unsupervised learning (e.g. node clustering). Despite its wide range of possible applications, graph level unsupervised learning has not received much attention yet. This might be mainly attributed to the high representation complexity of graphs, which can be represented by n! equivalent adjacency matrices, where n is the number of nodes. In this work we address this issue by proposing a permutation invariant variational autoencoder for graph structured data. Our proposed model indirectly learns to match the node ordering of input and output graph, without imposing a particular node ordering or performing expensive graph matching. We demonstrate the effectiveness of our proposed model on various graph reconstruction and generation tasks and evaluate the expressive power of extracted representations for downstream graph level classification and regression.


The Mixed Page Number of Graphs. A linear layout of a graph typically consists of a total vertex order, and a partition of the edges into sets of either non crossing edges, called stacks, or non nested edges, called queues. The stack (queue) number of a graph is the minimum number of required stacks (queues) in a linear layout. Mixed linear layouts combine these layouts by allowing each set of edges to form either a stack or a queue. In this work we initiate the study of the mixed page number of a graph which corresponds to the minimum number of such sets. First, we study the edge density of graphs with bounded mixed page number. Then, we focus on complete and complete bipartite graphs, for which we derive lower and upper bounds on their mixed page number. Our findings indicate that combining stacks and queues is more powerful in various ways compared to the two traditional layouts.


AdaMatch A Unified Approach to Semi Supervised Learning and Domain Adaptation. We extend semi supervised learning to the problem of domain adaptation to learn significantly higher accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a method that unifies the tasks of unsupervised domain adaptation (UDA), semi supervised learning (SSL), and semi supervised domain adaptation (SSDA). In an extensive experimental study, we compare its behavior with respective state of the art techniques from SSL, SSDA, and UDA on vision classification tasks. We find AdaMatch either matches or significantly exceeds the state of the art in each case using the same hyper parameters regardless of the dataset or task. For example, AdaMatch nearly doubles the accuracy compared to that of the prior state of the art on the UDA task for DomainNet and even exceeds the accuracy of the prior state of the art obtained with pre training by 6.4 when AdaMatch is trained completely from scratch. Furthermore, by providing AdaMatch with just one labeled example per class from the target domain (i.e., the SSDA setting), we increase the target accuracy by an additional 6.1 , and with 5 labeled examples, by 13.6 .


Learning to Track Instances without Video Annotations. Tracking segmentation masks of multiple instances has been intensively studied, but still faces two fundamental challenges 1) the requirement of large scale, frame wise annotation, and 2) the complexity of two stage approaches. To resolve these challenges, we introduce a novel semi supervised framework by learning instance tracking networks with only a labeled image dataset and unlabeled video sequences. With an instance contrastive objective, we learn an embedding to discriminate each instance from the others. We show that even when only trained with images, the learned feature representation is robust to instance appearance variations, and is thus able to track objects steadily across frames. We further enhance the tracking capability of the embedding by learning correspondence from unlabeled videos in a self supervised manner. In addition, we integrate this module into single stage instance segmentation and pose estimation frameworks, which significantly reduce the computational complexity of tracking compared to two stage networks. We conduct experiments on the YouTube VIS and PoseTrack datasets. Without any video annotation efforts, our proposed method can achieve comparable or even better performance than most fully supervised methods.


Rovibronic spectroscopy of PN from first principles. We report an ab initio study on the rovibronic spectroscopy of the closed shell diatomic molecule phosphorous mononitride, PN. The study considers the nine lowest electronic states, X , 1 Sigma , A , 1 Pi , C , 1 Sigma , D , 1 Delta , E , 1 Sigma , a , 3 Sigma , b , 3 Pi , d , 3 Delta and e , 3 Sigma using high level electronic structure theory and accurate nuclear motion calculations. The ab initio data cover 9 potential energy, 14 spin orbit coupling, 7 electronic angular momentum coupling, 9 electric dipole moment and 8 transition dipole moment curves. The Duo nuclear motion program is used to solve the coupled nuclear motion Schr " o dinger equations for these nine electronic states and to simulate rovibronic absorption spectra of 31 P 14 N for different temperatures, which are compared to available spectroscopic studies. Lifetimes for all states are calculated and compared to previous results from the literature. The calculated lifetime of the A , 1 Pi state shows good agreement with an experimental value from the literature, which is an important quality indicator for the ab initio A X transition dipole moment.


Two stage Rule induction Visual Reasoning on RPMs with an Application to Video Prediction. Raven's Progressive Matrices (RPMs) are frequently used in evaluating human's visual reasoning ability. Researchers have made considerable efforts in developing systems to automatically solve the RPM problem, often through a black box end to end convolutional neural network for both visual recognition and logical reasoning tasks. Based on the two intrinsic natures of RPM problem, visual recognition and logical reasoning, we propose a Two stage Rule Induction Visual Reasoner (TRIVR), which consists of a perception module and a reasoning module, to tackle the challenges of real world visual recognition and subsequent logical reasoning tasks, respectively. For the reasoning module, we further propose a "2 1" formulation that models human's thinking in solving RPMs and significantly reduces the model complexity. It derives a reasoning rule from each RPM sample, which is not feasible for existing methods. As a result, the proposed reasoning module is capable of yielding a set of reasoning rules modeling human in solving the RPM problems. To validate the proposed method on real world applications, an RPM like Video Prediction (RVP) dataset is constructed, where visual reasoning is conducted on RPMs constructed using real world video frames. Experimental results on various RPM like datasets demonstrate that the proposed TRIVR achieves a significant and consistent performance gain compared with the state of the art models.


GP Context free Grammar Pre training for Text to SQL Parsers. A new method for Text to SQL parsing, Grammar Pre training (GP), is proposed to decode deep relations between question and database. Firstly, to better utilize the information of databases, a random value is added behind a question word which is recognized as a column, and the new sentence serves as the model input. Secondly, initialization of vectors for decoder part is optimized, with reference to the former encoding so that question information can be concerned. Finally, a new approach called flooding level is adopted to get the non zero training loss which can generalize better results. By encoding the sentence with GRAPPA and RAT SQL model, we achieve better performance on spider, a cross DB Text to SQL dataset (72.8 dev, 69.8 test). Experiments show that our method is easier to converge during training and has excellent robustness.


Multiscale study of high energy attosecond pulse interaction with matter and application to proton Boron fusion. For several decades, the interest of the scientific community in aneutronic fusion reactions such as proton Boron fusion has grown because of potential applications in different fields. Recently, many scientific teams in the world have worked experimentally on the possibility to trigger proton Boron fusion using intense lasers demonstrating an important renewal of interest of this field. It is now possible to generate ultra short high intensity laser pulses at high repetition rate. These pulses also have unique properties that can be leveraged to produce proton Boron fusion reactions. In this article, we investigate the interaction of a high energy attosecond pulse with a solid proton Boron target and the associated ion acceleration supported by numerical simulations. We demonstrate the efficiency of single cycle attosecond pulses in comparison to multi cycle attosecond pulses in ion acceleration and magnetic field generation. Using these results we also propose a path to proton Boron fusion using high energy attosecond pulses.


On the number of monogenizations of a quartic order. We show that an order in a quartic field has fewer than 3000 essentially different generators as a mathbb Z algebra (and fewer than 200 if the discriminant of the order is sufficiently large). This significantly improves the previously best known bound of 2 72 . Analogously, we show that an order in a quartic field is isomorphic to the invariant order of at most 10 classes of integral binary quartic forms (and at most 7 if the discriminant is sufficiently large). This significantly improves the previously best known bound of 2 80 .


Detection of acoustic events in Lavender for measuring the xylem vulnerability to embolism and cellular damages. Acoustic emission analysis is a promising technique to investigate the physiological events leading to drought induced injuries and mortality. However, the nature and the source of the acoustic emissions are not fully understood and make the use of this technique difficult as a direct measure of the loss of xylem hydraulic conductance. In this study, acoustic emissions were recorded during severe dehydration in lavender plants and compared to the dynamics of embolism development and cell lysis. The timing and characteristics of acoustic signals from two independent recording systems were compared by principal component analysis. In parallel, changes in water potential, branch diameter, loss of hydraulic conductance and electrolyte leakage were measured to quantify drought induced damages. Two distinct phases of acoustic emissions were observed during dehydration the first one associated with a rapid loss of diameter and a significant increase in loss of xylem conductance (90 ) and the second one with a significant increase in electrolyte leakage and slower diameter changes. This second phase corresponds to a complete loss of recovery capacity. The acoustic signals of both phases were discriminated by the third and fourth principal components. The loss of hydraulic conductance during the first acoustic phase suggests the hydraulic origin of these signals (i.e. cavitation events). For the second phase, the signals showed much higher variability between plants and acoustic systems suggesting that the sources of these signals may be plural, although likely including cellular damage. A simple algorithm was developed to discriminate hydraulic related acoustic signals from other sources, allowing the reconstruction of dynamic hydraulic vulnerability curves. However, hydraulic failure precedes cellular damage and lack of whole plant recovery is associated to these latter.


Investigating properties of Cl and Au ions using relativistic many body methods. We investigate ground state properties of singly charged chlorine (Cl ) and gold (Au ) negative ions by employing four component relativistic many body methods. In our approach, we attach an electron to the respective outer orbitals of chlorine (Cl) and gold (Au) atoms to determine the Dirac Fock (DF) wave functions of the ground state configurations of Cl and Au , respectively. As a result, all the single particle orbitals see the correlation effects due to the appended electron of the negative ion. After obtaining the DF wave functions, lower order many body perturbation methods, random phase approximation, and coupled cluster (CC) theory in the singles and doubles approximation are applied to obtain the ground state wave functions of both Cl and Au ions. Then, we adopt two different approaches to the CC theory a perturbative approach due to the dipole operator to determine electric dipole polarizability and an electron detachment approach in the Fock space framework to estimate ionization potential. Our calculations are compared with the available experimental and other theoretical results.


High throughput volumetric adaptive optical imaging using compressed time reversal matrix. Deep tissue optical imaging suffers from the reduction of resolving power due to tissue induced optical aberrations and multiple scattering noise. Reflection matrix approaches recording the maps of backscattered waves for all the possible orthogonal input channels have provided formidable solutions for removing severe aberrations and recovering the ideal diffraction limited spatial resolution without relying on fluorescence labeling and guide stars. However, measuring the full input output response of the tissue specimen is time consuming, making the real time image acquisition difficult. Here, we present the use of a time reversal matrix, instead of the reflection matrix, for fast high resolution volumetric imaging of a mouse brain. The time reversal matrix reduces two way problem to one way problem, which effectively relieves the requirement for the coverage of input channels. Using a newly developed aberration correction algorithm designed for the time reversal matrix, we demonstrated the correction of complex aberrations using as small as 2 of the complete basis while maintaining the image reconstruction fidelity comparable to the fully sampled reflection matrix. Due to nearly 100 fold reduction in the matrix recording time, we could achieve real time aberration correction imaging for a field of view of 40 x 40 microns (176 x 176 pixels) at a frame rate of 80 Hz. Furthermore, we demonstrated high throughput volumetric adaptive optical imaging of a mouse brain by recording a volume of 128 x 128 x 125 microns (568 x 568 x 125 voxels) in 3.58 s, correcting tissue aberrations at each and every 1 micron depth section, and visualizing myelinated axons with a lateral resolution of 0.45 microns and an axial resolution of 2 microns.


"Everyone is new to this" Student reflections on different aspects of online learning. In 2020, many instructors and students at colleges and universities were thrust into an unprecedented situation as a result of the COVID 19 pandemic disruptions. Even though they typically engage in in person teaching and learning in brick and mortar classrooms, remote instruction was the only possibility. Many instructors at our institution who had to switch from in person to remote instruction without any notice earlier in the year worked extremely hard to design and teach online courses to support their students during the second half of 2020. Since different instructors chose different pedagogical approaches for remote instruction, students taking multiple remote classes simultaneously experienced a variety of instructional strategies. We present an analysis of students' perceptions of remote learning in their lecture based, active learning, and lab physics classes at a large research university in the USA, focusing on positive and negative aspects including collaboration, communication, and assessment. Student reflections emphasized the importance of grade incentives for out of class and in class work frequent, low stakes assessments community building activities and opportunities to study with peers. Reflecting on the challenges and successes of different types of remote instructional approaches from students' perspective could provide useful insight to guide the design of future online courses as well as some aspects of in person courses.


PIETS Parallelised Irregularity Encoders for Forecasting with Heterogeneous Time Series. Heterogeneity and irregularity of multi source data sets present a significant challenge to time series analysis. In the literature, the fusion of multi source time series has been achieved either by using ensemble learning models which ignore temporal patterns and correlation within features or by defining a fixed size window to select specific parts of the data sets. On the other hand, many studies have shown major improvement to handle the irregularity of time series, yet none of these studies has been applied to multi source data. In this work, we design a novel architecture, PIETS, to model heterogeneous time series. PIETS has the following characteristics (1) irregularity encoders for multi source samples that can leverage all available information and accelerate the convergence of the model (2) parallelised neural networks to enable flexibility and avoid information overwhelming and (3) attention mechanism that highlights different information and gives high importance to the most related data. Through extensive experiments on real world data sets related to COVID 19, we show that the proposed architecture is able to effectively model heterogeneous temporal data and outperforms other state of the art approaches in the prediction task.


Trainable Class Prototypes for Few Shot Learning. Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within the meta training and task training framework. Also to avoid the disadvantages that the episodic meta training brought, we adopt non episodic meta training based on self supervised learning. Overall we solve the few shot tasks in two phases meta training a transferable feature extractor via self supervised learning and training the prototypes for metric classification. In addition, the simple attention mechanism is used in both meta training and task training. Our method achieves state of the art performance in a variety of established few shot tasks on the standard few shot visual classification dataset, with about 20 increase compared to the available unsupervised few shot learning methods.


DiCE4EL Interpreting Process Predictions using a Milestone Aware Counterfactual Approach. Predictive process analytics often apply machine learning to predict the future states of a running business process. However, the internal mechanisms of many existing predictive algorithms are opaque and a human decision maker is unable to understand emph why a certain activity was predicted. Recently, counterfactuals have been proposed in the literature to derive human understandable explanations from predictive models. Current counterfactual approaches consist of finding the minimum feature change that can make a certain prediction flip its outcome. Although many algorithms have been proposed, their application to multi dimensional sequence data like event logs has not been explored in the literature. In this paper, we explore the use of a recent, popular model agnostic counterfactual algorithm, DiCE, in the context of predictive process analytics. The analysis reveals that DiCE is unable to derive explanations for process predictions, due to (1) process domain knowledge not being taken into account, (2) long traces of process execution that often tend to be less understandable, and (3) difficulties in optimising the counterfactual search with categorical variables. We design an extension of DiCE, namely DiCE4EL (DiCE for Event Logs), that can generate counterfactual explanations for process prediction, and propose an approach that supports deriving milestone aware counterfactual explanations at key intermediate stages along process execution to promote interpretability. We apply our approach to a publicly available real life event log and the analysis results demonstrate the effectiveness of the proposed approach.


Right triangulated categories As extriangulated categories, aisles and co aisles. Right triangulated categories can be thought of as triangulated categories whose shift functor is not an equivalence. We give intrinsic characterisations of when such categories have a natural extriangulated structure and are appearing as the (co )aisle of a (co )t structure in an associated triangulated category.


Interacting helical traveling waves for the Gross Pitaevskii equation. We consider the 3D Gross Pitaevskii equation begin equation nonumber i partial t psi Delta psi (1 psi 2) psi 0 text for psi mathbb R times mathbb R 3 rightarrow mathbb C end equation and construct traveling waves solutions to this equation. These are solutions of the form psi(t,x) u(x 1,x 2,x 3 Ct) with a velocity C of order varepsilon log varepsilon for a small parameter varepsilon 0 . We build two different types of solutions. For the first type, the functions u have a zero set (vortex set) close to an union of n helices for n geq 2 and near these helices u has degree 1. For the second type, the functions u have a vortex filament of degree 1 near the vertical axis e 3 and n geq 4 vortex filaments of degree 1 near helices whose axis is e 3 . In both cases the helices are at a distance of order 1 ( varepsilon sqrt log varepsilon ) from the axis and are solutions to the Klein Majda Damodaran system, supposed to describe the evolution of nearly parallel vortex filaments in ideal fluids. Analogous solutions have been constructed recently by the authors for the stationary Gross Pitaevskii equation, namely the Ginzburg Landau equation. To prove the existence of these solutions we use the Lyapunov Schmidt method and a subtle separation between even and odd Fourier modes of the error of a suitable approximation.


Memory Free Generative Replay For Class Incremental Learning. Regularization based methods are beneficial to alleviate the catastrophic forgetting problem in class incremental learning. With the absence of old task images, they often assume that old knowledge is well preserved if the classifier produces similar output on new images. In this paper, we find that their effectiveness largely depends on the nature of old classes they work well on classes that are easily distinguishable between each other but may fail on more fine grained ones, e.g., boy and girl. In spirit, such methods project new data onto the feature space spanned by the weight vectors in the fully connected layer, corresponding to old classes. The resulting projections would be similar on fine grained old classes, and as a consequence the new classifier will gradually lose the discriminative ability on these classes. To address this issue, we propose a memory free generative replay strategy to preserve the fine grained old classes characteristics by generating representative old images directly from the old classifier and combined with new data for new classifier training. To solve the homogenization problem of the generated samples, we also propose a diversity loss that maximizes Kullback Leibler (KL) divergence between generated samples. Our method is best complemented by prior regularization based methods proved to be effective for easily distinguishable old classes. We validate the above design and insights on CUB 200 2011, Caltech 101, CIFAR 100 and Tiny ImageNet and show that our strategy outperforms existing memory free methods with a clear margin. Code is available at https github.com xmengxin MFGR


Cross modality Discrepant Interaction Network for RGB D Salient Object Detection. The popularity and promotion of depth maps have brought new vigor and vitality into salient object detection (SOD), and a mass of RGB D SOD algorithms have been proposed, mainly concentrating on how to better integrate cross modality features from RGB image and depth map. For the cross modality interaction in feature encoder, existing methods either indiscriminately treat RGB and depth modalities, or only habitually utilize depth cues as auxiliary information of the RGB branch. Different from them, we reconsider the status of two modalities and propose a novel Cross modality Discrepant Interaction Network (CDINet) for RGB D SOD, which differentially models the dependence of two modalities according to the feature representations of different layers. To this end, two components are designed to implement the effective cross modality interaction 1) the RGB induced Detail Enhancement (RDE) module leverages RGB modality to enhance the details of the depth features in low level encoder stage. 2) the Depth induced Semantic Enhancement (DSE) module transfers the object positioning and internal consistency of depth features to the RGB branch in high level encoder stage. Furthermore, we also design a Dense Decoding Reconstruction (DDR) structure, which constructs a semantic block by combining multi level encoder features to upgrade the skip connection in the feature decoding. Extensive experiments on five benchmark datasets demonstrate that our network outperforms 15 state of the art methods both quantitatively and qualitatively. Our code is publicly available at https rmcong.github.io proj CDINet.html.


Improving ClusterGAN Using Self AugmentedInformation Maximization of Disentangling LatentSpaces. The Latent Space Clustering in Generative adversarial networks (ClusterGAN) method has been successful with high dimensional data. However, the method assumes uniformlydistributed priors during the generation of modes, which isa restrictive assumption in real world data and cause loss ofdiversity in the generated modes. In this paper, we proposeself augmentation information maximization improved Clus terGAN (SIMI ClusterGAN) to learn the distinctive priorsfrom the data. The proposed SIMI ClusterGAN consists offour deep neural networks self augmentation prior network,generator, discriminator and clustering inference autoencoder.The proposed method has been validated using seven bench mark data sets and has shown improved performance overstate of the art methods. To demonstrate the superiority ofSIMI ClusterGAN performance on imbalanced dataset, wehave discussed two imbalanced conditions on MNIST datasetswith one class imbalance and three classes imbalanced cases.The results highlight the advantages of SIMI ClusterGAN.


A Framework for Understanding AI Induced Field Change How AI Technologies are Legitimized and Institutionalized. Artificial intelligence (AI) systems operate in increasingly diverse areas, from healthcare to facial recognition, the stock market, autonomous vehicles, and so on. While the underlying digital infrastructure of AI systems is developing rapidly, each area of implementation is subject to different degrees and processes of legitimization. By combining elements from institutional theory and information systems theory, this paper presents a conceptual framework to analyze and understand AI induced field change. The introduction of novel AI agents into new or existing fields creates a dynamic in which algorithms (re)shape organizations and institutions while existing institutional infrastructures determine the scope and speed at which organizational change is allowed to occur. Where institutional infrastructure and governance arrangements, such as standards, rules, and regulations, still are unelaborate, the field can move fast but is also more likely to be contested. The institutional infrastructure surrounding AI induced fields is generally little elaborated, which could be an obstacle to the broader institutionalization of AI systems going forward.


The p norm of circulant matrices via Fourier analysis. A recent paper computed the induced p norm of a special class of circulant matrices A(n,a,b) in mathbb R n times n , with the diagonal entries equal to a in mathbb R and the off diagonal entries equal to b ge 0 . We provide shorter proofs for all the results therein using Fourier analysis. The key observation is that a circulant matrix is diagonalized by a DFT matrix. We obtain an exact expression for A p, 1 le p le infty , where A A(n,a,b), a ge 0 and for A 2 where A A(n, a,b), a ge 0 for the other p norms of A(n, a,b) , 2 p infty , we provide upper and lower bounds.


On discretizing sea ice dynamics on triangular meshes using vertex, cell or edge velocities. Discretization of the equations of Viscous Plastic and Elastic Viscous Plastic (EVP) sea ice dynamics on triangular meshes can be done by placing discrete velocities at vertices, cells or edges. Since there are more cells and edges than vertices, the cell and edge based discretizations simulate more linear kinematic features at the same mesh than the vertex discretization. However, the discretization based on cell and edge velocities suffer from kernels in the strain rate or stress divergence operators and need either special strain rate computations as proposed here for cell velocities, or stabilization as proposed earlier for edge velocities. An elementary Fourier analysis clarifies how kernels are removed, and also shows that cell and edge velocity placement leads to spurious branches of stress divergence operator with large negative eigenvalues. Although spurious branches correspond to fast decay and are not expected to distort sea ice dynamics, they demand either smaller internal time steps or higher stability parameters in explicit EVP like methods.


Controllable Summarization with Constrained Markov Decision Process. We study controllable text summarization which allows users to gain control on a particular attribute (e.g., length limit) of the generated summaries. In this work, we propose a novel training framework based on Constrained Markov Decision Process (CMDP), which conveniently includes a reward function along with a set of constraints, to facilitate better summarization control. The reward function encourages the generation to resemble the human written reference, while the constraints are used to explicitly prevent the generated summaries from violating user imposed requirements. Our framework can be applied to control important attributes of summarization, including length, covered entities, and abstractiveness, as we devise specific constraints for each of these aspects. Extensive experiments on popular benchmarks show that our CMDP framework helps generate informative summaries while complying with a given attribute's requirement.


Socio meteorology flood prediction, social preparedness, and cry wolf effects. To improve the efficiency of flood early warning systems (FEWS), it is important to understand the interactions between natural and social systems. The high level of trust in authorities and experts is necessary to improve the likeliness of individuals to take preparedness actions responding to warnings. Despite a lot of efforts to develop the dynamic model of human and water in socio hydrology, no socio hydrological models explicitly simulate social collective trust in FEWS. Here we develop the stylized model to simulate the interactions of flood, social collective memory, social collective trust in FEWS, and preparedness actions responding to warnings by extending the existing socio hydrological model. We realistically simulate the cry wolf effect, in which many false alarms undermine the credibility of the early warning systems and make it difficult to induce preparedness actions. We found (1) considering the dynamics of social collective trust in FEWS is more important in the technological society with infrequent flood events than in the green society with frequent flood events (2) as the natural scientific skill to predict flood events is improved, the efficiency of FEWS gets more sensitive to the behavior of social collective trust, so that forecasters need to determine their warning threshold by considering the social aspects.


Subelliptic sharp G r a rding inequality on compact Lie groups. In this work we establish a subelliptic sharp G r a rding inequality on compact Lie groups for pseudo differential operators with symbols belonging to global subelliptic H "ormander classes. In order for the inequality to hold we require the global matrix valued symbol to satisfy the suitable classical nonnegativity condition in our setting. Our result extends to mathscr S m rho, delta (G) classes, 0 leq delta rho , the one in 26 about the validity of the sharp G r a rding inequality for the class mathscr S m 1,0 (G) . We remark that the result we prove here is already new and sharp in the case of the torus.


Efficient Large Scale Face Clustering Using an Online Mixture of Gaussians. In this work, we address the problem of large scale online face clustering given a continuous stream of unknown faces, create a database grouping the incoming faces by their identity. The database must be updated every time a new face arrives. In addition, the solution must be efficient, accurate and scalable. For this purpose, we present an online gaussian mixture based clustering method (OGMC). The key idea of this method is the proposal that an identity can be represented by more than just one distribution or cluster. Using feature vectors (f vectors) extracted from the incoming faces, OGMC generates clusters that may be connected to others depending on their proximity and their robustness. Every time a cluster is updated with a new sample, its connections are also updated. With this approach, we reduce the dependency of the clustering process on the order and the size of the incoming data and we are able to deal with complex data distributions. Experimental results show that the proposed approach outperforms state of the art clustering methods on large scale face clustering benchmarks not only in accuracy, but also in efficiency and scalability.


Some Bounds for Number of Solutions to ax by cz n and their Applications. In a recent work, the present author developed an efficient method to find the number of solutions of ax by cz n in non negative integer triples (x,y,z) where a,b,c and n are given natural numbers. In this note, we use that formula to obtain some simple looking bounds for the number of solutions of ax by cz n . Using these bounds, we solve some special cases of a problem related to the generalization of Frobenius coin problem in three variables. Moreover, we use these bounds to disprove a recent conjecture of He, Shiue and Venkat regarding the solution structure of ax by cz n .


Wireframe Based UI Design Search Through Image Autoencoder. UI design is an integral part of software development. For many developers who do not have much UI design experience, exposing them to a large database of real application UI designs can help them quickly build up a realistic understanding of the design space for a software feature and get design inspirations from existing applications. However, existing keyword based, image similarity based, and component matching based methods cannot reliably find relevant high fidelity UI designs in a large database alike to the UI wireframe that the developers sketch, in face of the great variations in UI designs. In this article, we propose a deep learning based UI design search engine to fill in the gap. The key innovation of our search engine is to train a wireframe image autoencoder using a large database of real application UI designs, without the need for labeling relevant UI designs. We implement our approach for Android UI design search, and conduct extensive experiments with artificially created relevant UI designs and human evaluation of UI design search results. Our experiments confirm the superior performance of our search engine over existing image similarity or component matching based methods and demonstrate the usefulness of our search engine in real world UI design tasks.


An English translation of L. Euler's "Calculations on aerostatic balloons made by the late Mr. Leonhard Euler, as they were found on his blackboard, after his death on 7 September 1783". This is an English translation of E579 in which the introductory remarks are in French, while Euler's original text is in Latin. By considering the balance of forces acting on a raising balloon on an isothermal atmosphere, namely the weight of the balloon, the buoyant force, and the aerodynamic drag force, Euler provides closed formulas for the calculation of the maximum altitude reached by the balloon, the altitude for which the velocity is maximum, the maximum velocity attained by the balloon, and the total ascending time.


Scalar Gaussian Wiretap Channel with Peak Amplitude Constraint Numerical Computation of the Optimal Input Distribution. This paper studies a scalar Gaussian wiretap channel where instead of an average input power constraint, we consider a peak amplitude constraint on the input. The goal is to obtain insights into the secrecy capacity and the structure of the secrecy capacity achieving distribution. Capitalizing on the recent theoretical progress on the structure of the secrecy capacity achieving distribution, this paper develops a numerical procedure, based on the gradient ascent algorithm and a version of the Blahut Arimoto algorithm, for computing the secrecy capacity and the secrecy capacity achieving input and output distributions.


A proof of Kosniowski conjecture. Let M be a unitary S 1 manifold with only isolated fixed points such that M is not a boundary. We show that 4 chi(M) dim M , where chi(M) is the Euler characteristic of M . This gives an affirmative answer of Kosniowski conjecture.


About quasi renewal processes and quasi regenerative processes. We discuss the concepts of quasi renewal and quasi regenerative processes. We also propose a method for obtaining the upper bounds for the convergence rate of the distribution of a regenerative and quasi regenerative process to a stationary distribution, if this process is ergodic.


Anomaly Clustering Grouping Images into Coherent Clusters of Anomaly Types. We introduce anomaly clustering, whose goal is to group data into semantically coherent clusters of anomaly types. This is different from anomaly detection, whose goal is to divide anomalies from normal data. Unlike object centered image clustering applications, anomaly clustering is particularly challenging as anomalous patterns are subtle and local. We present a simple yet effective clustering framework using a patch based pretrained deep embeddings and off the shelf clustering methods. We define a distance function between images, each of which is represented as a bag of embeddings, by the Euclidean distance between weighted averaged embeddings. The weight defines the importance of instances (i.e., patch embeddings) in the bag, which may highlight defective regions. We compute weights in an unsupervised way or in a semi supervised way if labeled normal data is available. Extensive experimental studies show the effectiveness of the proposed clustering framework along with a novel distance function upon existing multiple instance or deep clustering frameworks. Overall, our framework achieves 0.451 and 0.674 normalized mutual information scores on MVTec object and texture categories and further improve with a few labeled normal data (0.577, 0.669), far exceeding the baselines (0.244, 0.273) or state of the art deep clustering methods (0.176, 0.277).


Learning Inception Attention for Image Synthesis and Image Recognition. Image synthesis and image recognition have witnessed remarkable progress, but often at the expense of computationally expensive training and inference. Learning lightweight yet expressive deep model has emerged as an important and interesting direction. Inspired by the well known split transform aggregate design heuristic in the Inception building block, this paper proposes a Skip Layer Inception Module (SLIM) that facilitates efficient learning of image synthesis models, and a same layer variant (dubbed as SLIM too) as a stronger alternative to the well known ResNeXts for image recognition. In SLIM, the input feature map is first split into a number of groups (e.g., 4).Each group is then transformed to a latent style vector(via channel wise attention) and a latent spatial mask (via spatial attention). The learned latent masks and latent style vectors are aggregated to modulate the target feature map. For generative learning, SLIM is built on a recently proposed lightweight Generative Adversarial Networks (i.e., FastGANs) which present a skip layer excitation(SLE) module. For few shot image synthesis tasks, the proposed SLIM achieves better performance than the SLE work and other related methods. For one shot image synthesis tasks, it shows stronger capability of preserving images structures than prior arts such as the SinGANs. For image classification tasks, the proposed SLIM is used as a drop in replacement for convolution layers in ResNets (resulting in ResNeXt like models) and achieves better accuracy in theImageNet 1000 dataset, with significantly smaller model complexity


Predicting Game Engagement and Difficulty Using AI Players. This paper presents a novel approach to automated playtesting for the prediction of human player behavior and experience. It has previously been demonstrated that Deep Reinforcement Learning (DRL) game playing agents can predict both game difficulty and player engagement, operationalized as average pass and churn rates. We improve this approach by enhancing DRL with Monte Carlo Tree Search (MCTS). We also motivate an enhanced selection strategy for predictor features, based on the observation that an AI agent's best case performance can yield stronger correlations with human data than the agent's average performance. Both additions consistently improve the prediction accuracy, and the DRL enhanced MCTS outperforms both DRL and vanilla MCTS in the hardest levels. We conclude that player modelling via automated playtesting can benefit from combining DRL and MCTS. Moreover, it can be worthwhile to investigate a subset of repeated best AI agent runs, if AI gameplay does not yield good predictions on average.


GL GIN Fast and Accurate Non Autoregressive Model for Joint Multiple Intent Detection and Slot Filling. Multi intent SLU can handle multiple intents in an utterance, which has attracted increasing attention. However, the state of the art joint models heavily rely on autoregressive approaches, resulting in two issues slow inference speed and information leakage. In this paper, we explore a non autoregressive model for joint multiple intent detection and slot filling, achieving more fast and accurate. Specifically, we propose a Global Locally Graph Interaction Network (GL GIN) where a local slot aware graph interaction layer is proposed to model slot dependency for alleviating uncoordinated slots problem while a global intent slot graph interaction layer is introduced to model the interaction between multiple intents and all slots in the utterance. Experimental results on two public datasets show that our framework achieves state of the art performance while being 11.5 times faster.


A positivity preserving high order weighted compact nonlinear scheme for compressible gas liquid flows. We present a robust, highly accurate, and efficient positivity and boundedness preserving diffuse interface method for the simulations of compressible gas liquid two phase flows with the five equation model by Allaire et al. using high order finite difference weighted compact nonlinear scheme (WCNS) in the explicit form. The equation of states of gas and liquid are given by the ideal gas and stiffened gas laws respectively. Under a mild assumption on the relative magnitude between the ratios of specific heats of the gas and liquid, we can construct limiting procedures for the fifth order incremental stencil WCNS (WCNS IS) with the first order Harten Lax van Leer contact (HLLC) flux such that positive partial densities and squared speed of sound can be ensured in the solutions, together with bounded volume fractions and mass fractions. The limiting procedures are discretely conservative for all conservative equations in the five equation model and can also be easily extended for any other conservative finite difference or finite volume scheme. Numerical tests with liquid water and air are reported to demonstrate the robustness and high accuracy of the WCNS IS with the positivity and boundedness preserving limiters even under extreme conditions.


Fractality in a delayed prey predator ecological system with Allee effects. A delayed, discrete time, prey predator model with Allee effects imposed on prey and predator populations is defined, and dynamics of the system is characterized computationally. The parametric conditions for local asymptotic stability of equilibria are investigated with several illustrating examples. In addition, several periodic solutions were achieved. Furthermore, high degree of fractality of the prey predator population trajectories is observed when the system is sufficiently delayed. This system has turned out to be a cooperative system, which is depicted using fractal dimension.